-- Logs begin at Fri 2022-09-23 14:31:16 UTC, end at Fri 2022-09-23 15:32:09 UTC. -- Sep 23 15:04:01.880183 dv-osbrick-855012-3-ceph systemd[1]: Starting Devstack devstack@keystone.service... Sep 23 15:04:01.889519 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 23 15:04:01.891665 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 23 15:04:01 2022] *** Sep 23 15:04:01.891665 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 23 15:04:01.891665 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 23 15:04:01.891665 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: nodename: dv-osbrick-855012-3-ceph Sep 23 15:04:01.891665 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: machine: x86_64 Sep 23 15:04:01.891665 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: clock source: unix Sep 23 15:04:01.891665 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: pcre jit disabled Sep 23 15:04:01.891665 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: detected number of CPU cores: 4 Sep 23 15:04:01.891665 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: current working directory: / Sep 23 15:04:01.891665 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: detected binary path: /usr/bin/uwsgi-core Sep 23 15:04:01.891665 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: your processes number limit is 47680 Sep 23 15:04:01.891665 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: your memory page size is 4096 bytes Sep 23 15:04:01.891665 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: detected max file descriptor number: 2048 Sep 23 15:04:01.891665 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: lock engine: pthread robust mutexes Sep 23 15:04:01.892544 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: thunder lock: enabled Sep 23 15:04:01.892544 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 23 15:04:01.892544 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 23 15:04:01.937270 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: Python main interpreter initialized at 0x55994f8129c0 Sep 23 15:04:01.937270 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: python threads support enabled Sep 23 15:04:01.937270 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: your server socket listen backlog is limited to 100 connections Sep 23 15:04:01.937270 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: your mercy for graceful operations on workers is 90 seconds Sep 23 15:04:01.937618 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: mapped 403077 bytes (393 KB) for 2 cores Sep 23 15:04:01.937618 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: *** Operational MODE: preforking *** Sep 23 15:04:01.938007 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: *** uWSGI is running in multiple interpreter mode *** Sep 23 15:04:01.938007 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: spawned uWSGI master process (pid: 88294) Sep 23 15:04:01.938223 dv-osbrick-855012-3-ceph systemd[1]: Started Devstack devstack@keystone.service. Sep 23 15:04:01.939241 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: spawned uWSGI worker 1 (pid: 88305, cores: 1) Sep 23 15:04:01.939241 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: spawned uWSGI worker 2 (pid: 88306, cores: 1) Sep 23 15:04:01.939241 dv-osbrick-855012-3-ceph devstack@keystone.service[88294]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 23 15:04:06.486262 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:04:06.486262 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: from cryptography.utils import int_from_bytes Sep 23 15:04:06.487106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:04:06.487106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: from cryptography.utils import int_from_bytes Sep 23 15:04:06.496145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:04:06.496145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: from cryptography.utils import int_from_bytes Sep 23 15:04:06.496656 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:04:06.496656 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: from cryptography.utils import int_from_bytes Sep 23 15:04:06.536540 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 15:04:06.536725 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 15:04:06.536860 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] command line args: [] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 15:04:06.537158 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 15:04:06.537291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ================================================================================ {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 15:04:06.537572 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] admin_token = **** {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.537847 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] config_dir = [] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.538019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.538230 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] config_source = [] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.538361 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] debug = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.538591 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.538943 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.539128 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.539380 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.539628 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.539919 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] list_limit = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.540080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] log_config_append = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.540237 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.540438 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] log_dir = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.540599 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] log_file = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.540824 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.541070 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.541315 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.541564 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.541774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.541941 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.542185 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.542431 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.542665 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.542808 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 15:04:06.542930 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.543050 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 15:04:06.543134 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.543252 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] command line args: [] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 15:04:06.543365 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.543486 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 15:04:06.543597 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.543703 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ================================================================================ {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 15:04:06.543810 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.543922 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] admin_token = **** {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.544051 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] config_dir = [] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.544140 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.544208 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.544398 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] config_source = [] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.544521 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.544609 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] debug = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.544725 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] publish_errors = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.544800 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.544946 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.545031 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.545152 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.545227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.545343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.545422 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.545548 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.545628 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.545775 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.545853 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] list_limit = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.545994 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] log_config_append = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.546085 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] standard_threads = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.546165 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.546238 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.546309 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] log_dir = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.546470 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.546554 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] log_file = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.546629 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.546709 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.546783 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] use_journal = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.546931 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.547020 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] use_json = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.547098 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] use_stderr = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.547174 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.547282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] use_syslog = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.547371 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.547521 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.547609 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.547689 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.547760 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.547939 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.548022 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.548177 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.548281 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.548398 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.548494 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.548633 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.548722 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.548856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.548937 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.549083 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.549166 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.549319 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.549402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.549559 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.549642 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.549865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.549951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.550120 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.550337 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.550427 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.550508 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] publish_errors = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.550591 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.550715 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.550802 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.550949 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.551041 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.551114 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.551268 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.551358 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.551506 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.551588 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.551761 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.551876 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] standard_threads = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.551980 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.552075 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.552183 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.552279 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.552382 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.552485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.552593 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] use_journal = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.552699 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] use_json = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.552783 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.552898 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] use_stderr = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.552986 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.553060 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] use_syslog = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.553174 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.553255 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:04:06.553421 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.553513 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.553655 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.553771 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.553883 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.554003 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.554117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.554192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.554319 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.554403 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.554578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.554660 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.554825 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.554907 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.555058 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.555132 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.555247 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.555322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.555525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.555616 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.555768 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.555851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.556011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.556090 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.556256 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.556350 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.556484 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.556570 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.556718 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.556800 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.556956 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.557046 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.557186 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.557274 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.557415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.557609 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.557723 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.557871 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.558015 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.558093 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.558339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.558417 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.558570 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.558724 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.558804 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.559023 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.559100 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.559256 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.559473 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.559562 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.559721 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.559853 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.559951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.560188 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.560266 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.560423 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.560553 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.560658 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.560893 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.560969 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.561127 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.561277 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.561352 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.561566 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.561716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.561956 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.562035 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.562193 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.562357 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.562436 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.562676 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.562759 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.562914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.563078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.563158 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.563369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.563447 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.563605 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.563801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.563893 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.564107 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.564184 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.564359 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.564490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.564605 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.564843 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.564927 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.565079 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.565189 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.565316 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.565542 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.565635 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.565813 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.565917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.566054 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.566262 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.566342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.566525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.566604 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.566772 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.566936 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.567015 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.567233 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.567313 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.567471 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.567638 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.567717 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.567932 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.568013 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.568192 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.568318 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.568433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.568661 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.568739 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.568911 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.569012 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.569150 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.569359 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.569438 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.569784 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.569875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.569949 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.570082 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.570165 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.570312 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.570434 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.570542 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.570771 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.570857 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.571052 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.571236 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.571318 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.571516 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.571595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.571749 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.571933 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.572013 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.572223 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.572301 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.572477 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.572633 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.572736 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.572977 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.573056 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.573210 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] auth.external = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.573329 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.573443 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.573676 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.573830 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.573987 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.574217 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] auth.password = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.574296 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.574448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] auth.token = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.574579 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.574686 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.574920 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.574998 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.575165 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.575322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.575398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.575611 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.575690 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.575870 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.576017 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.576108 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.576326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] credential.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.576411 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.576574 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.576732 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.576812 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.577058 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.577145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.577313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.577535 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.577614 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.577804 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.577992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.578086 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.578295 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.578412 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.578532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.578786 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.578864 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.579066 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.579246 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.579326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.579558 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.579666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.579799 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.580055 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.580148 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.580291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] federation.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.580519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.580599 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.580764 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.580953 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.581042 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.581229 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.581369 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.581475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.581729 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.581811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.581987 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.582206 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.582288 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.582465 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.582629 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.582710 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.582937 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.583025 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.583173 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.583422 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.583501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.583668 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.583867 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.583956 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.584125 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.584297 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.584378 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.584592 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.584712 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.584828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.585075 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.585154 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.585323 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.585539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.585626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.585808 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.585983 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.586063 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.586233 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.586315 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.586471 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.586564 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.586728 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.586816 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.586962 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.587043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.587192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.587282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.587428 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.587510 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.587676 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.587755 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.587878 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.587967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.588117 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.588198 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.588365 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.588446 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.588603 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.588685 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.588840 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.588920 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.589082 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.589162 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.589320 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.589402 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.589549 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] auth.external = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.589628 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.589805 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.589888 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.590052 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.590134 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.590300 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.590389 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.590534 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.590615 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] auth.password = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.590759 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] auth.token = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.590840 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.590994 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.591074 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.591224 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.591305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.591454 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.591531 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.591678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.591759 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.591915 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.591996 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.592152 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.592234 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.592375 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.592455 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.592622 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.592702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] credential.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.592858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.593108 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.593189 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.593354 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.593504 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.593586 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.593835 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.593921 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.594140 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.594221 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.594396 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.594503 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.594633 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.594848 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.594929 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.595091 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.595211 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.595323 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.595561 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.595647 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.595826 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.595985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.596066 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.596289 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.596378 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.596534 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.596613 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.596779 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.596860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.597013 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.597102 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.597243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.597323 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.597478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.597559 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.597744 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.597840 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] federation.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.597972 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.598049 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.598202 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.598283 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.598449 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.598537 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.598677 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.598755 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.598923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.599005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.599156 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.599244 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.599401 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.599480 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.599631 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.599707 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.599877 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.599967 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.600110 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.600190 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.600343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.600420 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.600572 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.600652 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.600816 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.600897 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.601058 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.601139 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.601287 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.601369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.601515 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.601596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.601781 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.601876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.602011 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.602130 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.602507 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.602699 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.602779 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.602987 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.603154 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.603236 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.603426 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.603577 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.603657 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.603881 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.603997 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.604124 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.604276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.604356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.604527 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.604607 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.604764 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.604847 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.605004 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.605084 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.605249 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] resource.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.605329 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.605503 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.605585 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.605769 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.605862 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.606202 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.606283 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.606440 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.606984 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.607069 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.607221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.607302 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.607455 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.607545 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.607700 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.607800 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.607927 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.608024 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.608169 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.608260 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.608412 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.608497 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] role.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.608641 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.608727 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] role.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.608883 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.608991 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.609123 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.609204 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.609348 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.609429 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.609580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.609669 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.609879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.609960 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.610034 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.610107 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.610274 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.610369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.610514 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.610648 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.610981 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.611104 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.611217 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.611460 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.611542 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.611704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.611930 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.612009 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.612157 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.612400 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.612482 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.612643 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.612867 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.612949 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.613095 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.613321 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.613401 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.613544 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.613808 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.614020 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.614260 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.614408 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.614547 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.614687 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.614817 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.614933 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.615063 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.615146 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.615220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.615299 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.615374 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.615473 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.615595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.615729 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.615817 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.615993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.616074 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.616235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.616325 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.616470 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.616551 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.616703 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.616784 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.616938 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.617096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.617173 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.617245 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.617404 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.617485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.617646 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.617756 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.618118 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.618200 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.618363 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.618596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.618675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.618826 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.619056 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.619136 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.619285 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.619468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] token.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.619554 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.619757 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.619838 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.619990 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.620239 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.620318 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.620464 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.620615 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.620696 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.620927 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.621005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.621156 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.621364 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.621520 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.621601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.621884 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.621969 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.622136 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.622351 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.622448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.622615 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.622731 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.622857 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.623093 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.623171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.623343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.623503 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] resource.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.623630 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.623864 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.623952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.624110 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.624288 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.624377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.624630 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.connection = **** {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.624709 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.624879 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.625040 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.625120 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.625351 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.625433 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.625592 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.625814 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.625897 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.626087 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.626179 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.626324 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.626544 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.626624 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.626795 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.626909 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.627035 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.627268 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] role.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.627348 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.627504 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.627639 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] role.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.627754 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.627991 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.628072 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.628233 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.628372 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.628453 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.628693 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.628784 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.628925 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.629095 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 15:04:06.629174 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.629498 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.629874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.630251 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.630630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.631014 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.631374 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.631749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.632124 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.632504 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.632880 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.633572 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.633972 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.634363 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.634753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.635133 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.635513 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.635870 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.636250 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.636640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.636925 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.637272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.637627 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.638013 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.638393 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.638785 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.639162 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.639524 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.639884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.640234 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.640591 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] token.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.640963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.641341 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.641720 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.642120 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.642496 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.642856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.643226 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.643595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.643968 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.644327 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.644684 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.645037 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.645409 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.645874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.646224 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.646593 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.646992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.647388 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.connection = **** {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.647759 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.648135 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.648499 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.648864 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.649256 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.649552 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.649898 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.650263 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.650639 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.651006 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.651384 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.651743 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.652120 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.652481 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.652858 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.653211 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.653582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.653981 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:04:06.654206 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 15:04:06.658789 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.659020 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.659242 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.668031 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.689239 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.689497 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.689782 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.695841 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.696131 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.698272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.716090 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.716271 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.749532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.754369 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.797968 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.798193 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.798989 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.799219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.864425 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.864616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.864713 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.864830 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.864918 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.865076 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.865203 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.865288 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.865355 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.865476 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.865566 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.865719 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.888379 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.888607 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.888731 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.888801 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.888864 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.889045 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.889171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.889241 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.889304 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.889467 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.889594 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.889684 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.889806 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.889871 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.900880 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.901008 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.913267 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.913404 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.913474 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.913648 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.913793 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.913884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.913964 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.914111 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.914238 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.914308 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.914371 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.914462 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.914542 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.914697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:04:06.931335 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.931548 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 23 15:04:06.931700 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.931794 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 23 15:04:06.931870 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.932063 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 23 15:04:06.932231 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.932231 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 23 15:04:06.932390 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.932538 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.932663 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.932765 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.932854 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.933052 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.933177 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.933280 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.942522 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.942727 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.942853 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.942942 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.943023 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.943243 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.943369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.943516 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.950292 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:06.952921 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:06.953193 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:06.953481 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.953798 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.954092 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.954378 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.954640 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.954915 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.955191 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.955455 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.955729 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.955991 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.957537 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:06.957974 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.958367 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.958766 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.959162 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.959532 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.959917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.960305 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.960695 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.961088 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.961469 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.978789 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.980276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:06.980562 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.985469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:06.985752 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.987823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.991787 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.993356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:06.993638 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.994282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:06.994577 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.998118 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:06.998396 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.998583 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:06.998806 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.999089 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.999487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:06.999829 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.000048 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.000328 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.000453 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.000601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.006754 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.007038 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.011027 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.011317 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.011609 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.011999 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.012275 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.012548 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.012815 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.013111 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.016005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.016291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.020134 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.023263 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.023672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.027932 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.028480 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.028753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.031073 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.032593 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.034182 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.034481 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.034771 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.035176 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.035476 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.035697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.035828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.036101 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.040434 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.043440 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.046506 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.046801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.047080 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.047493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.047768 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.048046 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.051463 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.051755 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.052018 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.052283 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.059087 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.060739 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.062303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.062587 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.063678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.063960 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.064223 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.064487 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.065217 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.065505 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.065824 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.066119 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.066409 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.071165 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.072796 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.074347 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.074620 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.077196 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.077476 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.077618 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.077794 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.077939 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.078012 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.078173 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.078315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.078432 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.078753 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.079043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.079324 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.089459 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.089738 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.090035 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.090320 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.090608 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.090885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.091155 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.094846 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.097862 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.100742 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.102188 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.103708 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.103994 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.104296 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.106403 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.109714 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.111076 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.112538 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.112663 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.114023 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.115422 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.115549 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.115722 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.115848 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.116018 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.116142 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.116300 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.122463 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.123918 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.124225 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.124516 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.124800 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.126762 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.127047 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.127337 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.127608 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.132587 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.132874 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.133156 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.133432 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.133723 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.134018 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.134301 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.134571 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.134856 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.135125 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.135403 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.135627 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.135736 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.135910 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.135995 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.136181 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.136276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.143843 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:04:07.144121 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.144394 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.144667 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.144935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.145203 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.145484 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.145782 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.146036 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.146299 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.146574 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.146831 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.147101 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.147354 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:04:07.169038 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55994f8129c0 pid: 88305 (default app) Sep 23 15:04:07.172476 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad81b1-b559-46d8-a206-0853f66e6a4d None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:07.172764 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad81b1-b559-46d8-a206-0853f66e6a4d None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:07.173037 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad81b1-b559-46d8-a206-0853f66e6a4d None None] PATH_INFO: `/v3` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:07.177194 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Fri Sep 23 15:04:07 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:07.180068 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55994f8129c0 pid: 88306 (default app) Sep 23 15:04:14.380785 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3944dd-9bef-4d9d-aec6-4fd923316d97 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:14.381381 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3944dd-9bef-4d9d-aec6-4fd923316d97 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:14.381381 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3944dd-9bef-4d9d-aec6-4fd923316d97 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:14.383309 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:04:14.391098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a08f1d-4b1a-4ee4-9be1-413a334d11d9 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:14.391715 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a08f1d-4b1a-4ee4-9be1-413a334d11d9 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:14.391715 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a08f1d-4b1a-4ee4-9be1-413a334d11d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:14.467068 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: INFO dbcounter [None req-a0a08f1d-4b1a-4ee4-9be1-413a334d11d9 None None] Registered counter for database keystone Sep 23 15:04:14.488974 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG oslo_db.sqlalchemy.engines [None req-a0a08f1d-4b1a-4ee4-9be1-413a334d11d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:04:14.497401 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writer thread running {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:04:14.684414 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG passlib.handlers.bcrypt [None req-a0a08f1d-4b1a-4ee4-9be1-413a334d11d9 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88306) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 23 15:04:14.684760 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG passlib.handlers.bcrypt [None req-a0a08f1d-4b1a-4ee4-9be1-413a334d11d9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88306) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 23 15:04:14.744234 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-a0a08f1d-4b1a-4ee4-9be1-413a334d11d9 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:14.745850 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-a0a08f1d-4b1a-4ee4-9be1-413a334d11d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:14.878968 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 1/3] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 23 15:04:15.434267 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3944dd-9bef-4d9d-aec6-4fd923316d97 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:15.513732 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: INFO dbcounter [None req-cc3944dd-9bef-4d9d-aec6-4fd923316d97 None None] Registered counter for database keystone Sep 23 15:04:15.538888 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG oslo_db.sqlalchemy.engines [None req-cc3944dd-9bef-4d9d-aec6-4fd923316d97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:04:15.547700 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writer thread running {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:04:15.666793 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3944dd-9bef-4d9d-aec6-4fd923316d97 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:15.672266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62f32b-365f-43f1-96fc-8936215a6525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:15.672877 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62f32b-365f-43f1-96fc-8936215a6525 admin admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:15.673150 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62f32b-365f-43f1-96fc-8936215a6525 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:15.673414 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62f32b-365f-43f1-96fc-8936215a6525 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:15.682535 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62f32b-365f-43f1-96fc-8936215a6525 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:15.734145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2f62f32b-365f-43f1-96fc-8936215a6525 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 23 15:04:15.734490 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62f32b-365f-43f1-96fc-8936215a6525 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:15.745193 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 3/4] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Sep 23 15:04:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 15:04:15.751391 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a08f1d-4b1a-4ee4-9be1-413a334d11d9 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:15.769088 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a08f1d-4b1a-4ee4-9be1-413a334d11d9 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:15.775498 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6c51e-b579-4560-8632-accd84defde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:15.776611 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6c51e-b579-4560-8632-accd84defde7 admin admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:15.776889 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6c51e-b579-4560-8632-accd84defde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:15.777163 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6c51e-b579-4560-8632-accd84defde7 admin admin] PATH_INFO: `/v3/projects/c6971859b35b44e69f745ee34120421d` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:15.778879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6c51e-b579-4560-8632-accd84defde7 admin admin] RBAC: Authorizing `identity:get_project(project_id=c6971859b35b44e69f745ee34120421d)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:15.828872 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e8a6c51e-b579-4560-8632-accd84defde7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 23 15:04:15.829213 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6c51e-b579-4560-8632-accd84defde7 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:15.833712 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 2/5] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Sep 23 15:04:15 2022] GET /identity/v3/projects/c6971859b35b44e69f745ee34120421d => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:18.171406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950358f6-e60a-4548-912c-6326114ad72b None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:18.171980 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950358f6-e60a-4548-912c-6326114ad72b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:18.171980 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950358f6-e60a-4548-912c-6326114ad72b None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:18.176082 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 4/6] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:04:18.183109 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dc816-4f2e-4984-9c41-061306a634e1 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:18.183825 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dc816-4f2e-4984-9c41-061306a634e1 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:18.183995 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dc816-4f2e-4984-9c41-061306a634e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:18.216265 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-293dc816-4f2e-4984-9c41-061306a634e1 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:18.217842 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-293dc816-4f2e-4984-9c41-061306a634e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:18.228102 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 3/7] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 23 15:04:18.544495 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950358f6-e60a-4548-912c-6326114ad72b None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:18.558784 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950358f6-e60a-4548-912c-6326114ad72b None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:18.564176 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4b235-0e11-4139-81fa-a4b432efade4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:18.564768 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4b235-0e11-4139-81fa-a4b432efade4 admin admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:18.565102 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4b235-0e11-4139-81fa-a4b432efade4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:18.565379 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4b235-0e11-4139-81fa-a4b432efade4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:18.573623 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4b235-0e11-4139-81fa-a4b432efade4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:18.575440 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4b235-0e11-4139-81fa-a4b432efade4 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:18.584278 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 5/8] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Sep 23 15:04:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 15:04:18.590573 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dc816-4f2e-4984-9c41-061306a634e1 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:18.604288 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dc816-4f2e-4984-9c41-061306a634e1 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:18.610343 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336dbcb-d8a8-49be-a7b4-470ac1ffe641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:18.610981 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336dbcb-d8a8-49be-a7b4-470ac1ffe641 admin admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:18.611261 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336dbcb-d8a8-49be-a7b4-470ac1ffe641 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:18.611538 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336dbcb-d8a8-49be-a7b4-470ac1ffe641 admin admin] PATH_INFO: `/v3/users/652ac5e448bf46d3bcf76749e06bdf9d` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:18.612906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336dbcb-d8a8-49be-a7b4-470ac1ffe641 admin admin] RBAC: Authorizing `identity:get_user(user_id=652ac5e448bf46d3bcf76749e06bdf9d)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:18.614807 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336dbcb-d8a8-49be-a7b4-470ac1ffe641 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:18.616343 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 4/9] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Sep 23 15:04:18 2022] GET /identity/v3/users/652ac5e448bf46d3bcf76749e06bdf9d => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:21.040602 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df1c2e-0a27-49fa-8d90-737133f2a669 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:21.041093 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df1c2e-0a27-49fa-8d90-737133f2a669 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:21.041093 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df1c2e-0a27-49fa-8d90-737133f2a669 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:21.042521 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:21.047935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99774a-0121-478a-91db-ae9ed6651f3b None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:21.048338 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99774a-0121-478a-91db-ae9ed6651f3b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:21.048478 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99774a-0121-478a-91db-ae9ed6651f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:21.067566 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-3a99774a-0121-478a-91db-ae9ed6651f3b None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:21.068765 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-3a99774a-0121-478a-91db-ae9ed6651f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:21.069672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff5e53-0a7f-45a9-9bce-cfa64858e1e8 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:21.069989 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff5e53-0a7f-45a9-9bce-cfa64858e1e8 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:21.070267 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff5e53-0a7f-45a9-9bce-cfa64858e1e8 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:21.071614 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 7/11] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:04:21.076776 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b46cc-90b1-4e39-abb7-7f315d96f7a3 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:21.077054 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b46cc-90b1-4e39-abb7-7f315d96f7a3 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:21.077320 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b46cc-90b1-4e39-abb7-7f315d96f7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:21.119612 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG passlib.handlers.bcrypt [None req-c61b46cc-90b1-4e39-abb7-7f315d96f7a3 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88305) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 23 15:04:21.119997 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG passlib.handlers.bcrypt [None req-c61b46cc-90b1-4e39-abb7-7f315d96f7a3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88305) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 23 15:04:21.151153 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 5/12] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:21.168404 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-c61b46cc-90b1-4e39-abb7-7f315d96f7a3 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:21.170021 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-c61b46cc-90b1-4e39-abb7-7f315d96f7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:21.272211 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 8/13] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:21.466679 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99774a-0121-478a-91db-ae9ed6651f3b None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:21.491755 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:21.581116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b46cc-90b1-4e39-abb7-7f315d96f7a3 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:21.685364 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99774a-0121-478a-91db-ae9ed6651f3b None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:21.685614 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b46cc-90b1-4e39-abb7-7f315d96f7a3 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:21.688367 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:21.722947 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c794c9-0a92-4e81-a164-78d9c54d1848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:21.723600 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c794c9-0a92-4e81-a164-78d9c54d1848 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:21.723877 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c794c9-0a92-4e81-a164-78d9c54d1848 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:21.724151 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c794c9-0a92-4e81-a164-78d9c54d1848 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:21.725876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89121f4-ffe6-4431-83da-1c0edfe438ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:21.726918 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89121f4-ffe6-4431-83da-1c0edfe438ce None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:21.727222 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89121f4-ffe6-4431-83da-1c0edfe438ce None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:21.727479 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89121f4-ffe6-4431-83da-1c0edfe438ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:21.736119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c794c9-0a92-4e81-a164-78d9c54d1848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:04:21.745001 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-67c794c9-0a92-4e81-a164-78d9c54d1848 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:04:21.745001 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:21.745001 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:21.745001 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:21.745001 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:21.745001 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:21.745001 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:21.745001 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:21.745001 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:21.745001 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:21.745001 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:21.745001 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:21.745001 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:04:21.745001 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:04:21.745001 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:04:21.745001 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:04:21.745972 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:04:21.745972 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:04:21.745972 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:04:21.745972 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:04:21.745972 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:21.745972 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:21.745972 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:21.745972 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:21.745972 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:21.745972 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:21.745972 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:21.745972 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:21.745972 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:21.745972 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:21.745972 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:21.745972 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:21.746793 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:21.746793 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:21.746793 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:21.746793 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:21.746793 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:04:21.746793 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:04:21.746793 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:04:21.746793 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:04:21.746793 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:04:21.746793 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:04:21.746793 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:04:21.746793 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:04:21.746793 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 6/14] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 15:04:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:04:21.751933 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c794c9-0a92-4e81-a164-78d9c54d1848 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:21.798425 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89121f4-ffe6-4431-83da-1c0edfe438ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:21.799947 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89121f4-ffe6-4431-83da-1c0edfe438ce None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:21.833815 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:21.852361 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c794c9-0a92-4e81-a164-78d9c54d1848 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:21.887994 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c22091-3cd5-4786-bf5b-5525c93c107b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:21.888615 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c22091-3cd5-4786-bf5b-5525c93c107b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:21.888889 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c22091-3cd5-4786-bf5b-5525c93c107b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:21.889164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c22091-3cd5-4786-bf5b-5525c93c107b None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:21.889877 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c22091-3cd5-4786-bf5b-5525c93c107b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:21.890171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c22091-3cd5-4786-bf5b-5525c93c107b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:21.891585 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c22091-3cd5-4786-bf5b-5525c93c107b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:21.896906 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 9/15] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:04:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:04:21.903070 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89121f4-ffe6-4431-83da-1c0edfe438ce None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:21.904052 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 7/16] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:04:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:21.905946 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:21.909671 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c22091-3cd5-4786-bf5b-5525c93c107b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:22.002866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89121f4-ffe6-4431-83da-1c0edfe438ce None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:22.010217 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c22091-3cd5-4786-bf5b-5525c93c107b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:22.037029 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808f466-8c24-48ae-a2d6-e575636c2cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:22.037914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808f466-8c24-48ae-a2d6-e575636c2cdd None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:22.038394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808f466-8c24-48ae-a2d6-e575636c2cdd None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:22.038500 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808f466-8c24-48ae-a2d6-e575636c2cdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:22.042777 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7290755-26a0-4e45-ac80-2680bc1a430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:22.043414 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7290755-26a0-4e45-ac80-2680bc1a430a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:22.043691 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7290755-26a0-4e45-ac80-2680bc1a430a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:22.043962 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7290755-26a0-4e45-ac80-2680bc1a430a None admin] PATH_INFO: `/v3/users/652ac5e448bf46d3bcf76749e06bdf9d` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:22.045195 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7290755-26a0-4e45-ac80-2680bc1a430a None admin] RBAC: Authorizing `identity:get_user(user_id=652ac5e448bf46d3bcf76749e06bdf9d)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:22.046709 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7290755-26a0-4e45-ac80-2680bc1a430a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:22.048308 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 8/17] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:04:21 2022] GET /identity/v3/users/652ac5e448bf46d3bcf76749e06bdf9d => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:04:22.053792 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7290755-26a0-4e45-ac80-2680bc1a430a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:22.056701 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808f466-8c24-48ae-a2d6-e575636c2cdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:22.058222 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808f466-8c24-48ae-a2d6-e575636c2cdd None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:22.067963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:22.078201 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-e808f466-8c24-48ae-a2d6-e575636c2cdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:04:22.078201 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:22.078201 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:22.078201 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:22.078201 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:22.078201 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:22.078201 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:22.078201 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:22.078201 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:22.078201 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:22.078201 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:22.078201 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:22.078201 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:04:22.078201 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:04:22.078201 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:04:22.078201 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:04:22.079116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:22.079116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:22.079116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:22.079116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:22.079116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:22.079116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:22.079116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:22.079116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:22.079116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:22.079116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:22.079116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:22.079116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:22.079116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:22.079116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:22.079116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:22.079116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:22.079116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:04:22.079918 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:04:22.079918 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:04:22.079918 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:04:22.079918 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 10/18] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:04:22.085050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808f466-8c24-48ae-a2d6-e575636c2cdd None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:22.161337 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7290755-26a0-4e45-ac80-2680bc1a430a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:22.202098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d95fe-6711-4cbb-9ce7-fedfbae2852c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:22.202736 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d95fe-6711-4cbb-9ce7-fedfbae2852c None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:22.203013 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d95fe-6711-4cbb-9ce7-fedfbae2852c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:22.203283 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d95fe-6711-4cbb-9ce7-fedfbae2852c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:22.204392 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d95fe-6711-4cbb-9ce7-fedfbae2852c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:22.205886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d95fe-6711-4cbb-9ce7-fedfbae2852c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:22.207451 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 9/19] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:04:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:22.213567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d95fe-6711-4cbb-9ce7-fedfbae2852c None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:22.253651 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:22.298485 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:22.299923 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808f466-8c24-48ae-a2d6-e575636c2cdd None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:22.317562 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d95fe-6711-4cbb-9ce7-fedfbae2852c None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:22.335020 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627d049-8326-4e25-b7d8-3496f33883be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:22.335626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627d049-8326-4e25-b7d8-3496f33883be None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:22.335903 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627d049-8326-4e25-b7d8-3496f33883be None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:22.336168 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627d049-8326-4e25-b7d8-3496f33883be None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:22.336913 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627d049-8326-4e25-b7d8-3496f33883be None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:22.337208 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627d049-8326-4e25-b7d8-3496f33883be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:22.338642 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627d049-8326-4e25-b7d8-3496f33883be None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:22.351822 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6637cfa-d4aa-46e3-b0a4-cbc0b18d01e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:22.352490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6637cfa-d4aa-46e3-b0a4-cbc0b18d01e1 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:22.352762 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6637cfa-d4aa-46e3-b0a4-cbc0b18d01e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:22.353029 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6637cfa-d4aa-46e3-b0a4-cbc0b18d01e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:22.353761 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6637cfa-d4aa-46e3-b0a4-cbc0b18d01e1 None admin] RBAC: Adding query filter params (role.id=07d4069c848d4ee9abb586256ee26f20, scope.domain.id=default, user.id=652ac5e448bf46d3bcf76749e06bdf9d) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:22.354082 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6637cfa-d4aa-46e3-b0a4-cbc0b18d01e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:22.355767 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:04:22.355883 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6637cfa-d4aa-46e3-b0a4-cbc0b18d01e1 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:22.362810 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 10/21] 10.222.0.48 () {56 vars in 1322 bytes} [Fri Sep 23 15:04:22 2022] GET /identity/v3/role_assignments?user.id=652ac5e448bf46d3bcf76749e06bdf9d&scope.domain.id=default&role.id=07d4069c848d4ee9abb586256ee26f20 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:04:25.043563 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49cb27-3b48-420b-8e90-f738fc147d01 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:25.044560 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49cb27-3b48-420b-8e90-f738fc147d01 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:25.045039 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49cb27-3b48-420b-8e90-f738fc147d01 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:25.046629 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 12/22] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:04:25.052221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e685c94-d46c-4a68-8abf-cc37412200d0 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:25.053055 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e685c94-d46c-4a68-8abf-cc37412200d0 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:25.053523 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e685c94-d46c-4a68-8abf-cc37412200d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:25.083853 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-5e685c94-d46c-4a68-8abf-cc37412200d0 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:25.085481 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-5e685c94-d46c-4a68-8abf-cc37412200d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:25.183880 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:25.564612 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad955c1-5976-4b10-b97d-0b8aa5bd3647 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:25.565294 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad955c1-5976-4b10-b97d-0b8aa5bd3647 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:25.565801 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad955c1-5976-4b10-b97d-0b8aa5bd3647 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:25.567400 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:25.572885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740cb0a-49de-425f-afd6-bbfea711d420 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:25.573393 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740cb0a-49de-425f-afd6-bbfea711d420 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:25.573907 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740cb0a-49de-425f-afd6-bbfea711d420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:25.602869 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-6740cb0a-49de-425f-afd6-bbfea711d420 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:25.604469 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-6740cb0a-49de-425f-afd6-bbfea711d420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:25.677144 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090eaee-5d20-454e-90f4-6421986787de None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:25.677829 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090eaee-5d20-454e-90f4-6421986787de None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:25.678307 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090eaee-5d20-454e-90f4-6421986787de None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:25.680096 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 14/25] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:25.696530 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 12/26] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:25.704907 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d9cbc-d3a7-4504-a23b-ef825803015a None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:25.705458 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d9cbc-d3a7-4504-a23b-ef825803015a None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:25.705951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d9cbc-d3a7-4504-a23b-ef825803015a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:25.742677 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-492d9cbc-d3a7-4504-a23b-ef825803015a None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:25.743980 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-492d9cbc-d3a7-4504-a23b-ef825803015a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:25.838010 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 15/27] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:25.881571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a8e58-88a1-49e0-be1b-658dad6cc7e2 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:25.881891 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a8e58-88a1-49e0-be1b-658dad6cc7e2 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:25.882171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a8e58-88a1-49e0-be1b-658dad6cc7e2 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:25.883819 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 13/28] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:25.888882 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23618a48-9ddf-4639-ad95-a9f41aaab9f4 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:25.889220 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23618a48-9ddf-4639-ad95-a9f41aaab9f4 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:25.889506 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23618a48-9ddf-4639-ad95-a9f41aaab9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:25.915063 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-23618a48-9ddf-4639-ad95-a9f41aaab9f4 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:25.916315 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-23618a48-9ddf-4639-ad95-a9f41aaab9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:25.921642 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a8e58-88a1-49e0-be1b-658dad6cc7e2 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:25.925552 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:26.027098 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:26.075917 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 16/29] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:26.131474 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a8e58-88a1-49e0-be1b-658dad6cc7e2 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:26.163371 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23618a48-9ddf-4639-ad95-a9f41aaab9f4 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:26.207138 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be1108-1bf3-4c4b-8bd7-8f8a31cf2283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:26.207781 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be1108-1bf3-4c4b-8bd7-8f8a31cf2283 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:26.208060 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be1108-1bf3-4c4b-8bd7-8f8a31cf2283 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:26.208338 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be1108-1bf3-4c4b-8bd7-8f8a31cf2283 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:26.234993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be1108-1bf3-4c4b-8bd7-8f8a31cf2283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:04:26.243823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-a3be1108-1bf3-4c4b-8bd7-8f8a31cf2283 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:04:26.243823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:26.243823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:26.243823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:26.243823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:26.243823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:26.243823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:26.243823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:26.243823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:26.243823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:26.243823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:26.243823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:26.243823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:04:26.243823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:04:26.243823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:04:26.243823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:04:26.244693 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:04:26.244693 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:04:26.244693 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:04:26.244693 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:04:26.244693 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:26.244693 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:26.244693 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:26.244693 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:26.244693 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:26.244693 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:26.244693 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:26.244693 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:26.244693 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:26.244693 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:26.244693 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:26.244693 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:26.245456 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:26.245456 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:26.245456 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:26.245456 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:26.245456 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:04:26.245456 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:04:26.245456 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:04:26.245456 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:04:26.245456 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:04:26.245456 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:04:26.245456 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:04:26.245456 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:04:26.255963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 14/30] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 15:04:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:04:26.261066 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be1108-1bf3-4c4b-8bd7-8f8a31cf2283 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:26.368964 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23618a48-9ddf-4639-ad95-a9f41aaab9f4 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:26.371340 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:26.409130 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be1108-1bf3-4c4b-8bd7-8f8a31cf2283 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:26.448656 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0de14-55ed-432b-94e8-ba967101b292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:26.449425 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0de14-55ed-432b-94e8-ba967101b292 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:26.449919 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0de14-55ed-432b-94e8-ba967101b292 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:26.450309 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0de14-55ed-432b-94e8-ba967101b292 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:26.451093 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0de14-55ed-432b-94e8-ba967101b292 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:26.451517 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0de14-55ed-432b-94e8-ba967101b292 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:26.453052 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0de14-55ed-432b-94e8-ba967101b292 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:26.461593 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 15/31] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:04:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:04:26.462541 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0de14-55ed-432b-94e8-ba967101b292 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:26.463159 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b15e4-a327-4328-802e-6783c58162b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:26.463801 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b15e4-a327-4328-802e-6783c58162b7 None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:26.464085 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b15e4-a327-4328-802e-6783c58162b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:26.464362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b15e4-a327-4328-802e-6783c58162b7 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:26.465039 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b15e4-a327-4328-802e-6783c58162b7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:26.466605 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b15e4-a327-4328-802e-6783c58162b7 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:26.580992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0de14-55ed-432b-94e8-ba967101b292 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:26.610131 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:26.620114 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4022025-b5eb-481a-8500-0cfc8ddd736a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:26.620840 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4022025-b5eb-481a-8500-0cfc8ddd736a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:26.621191 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4022025-b5eb-481a-8500-0cfc8ddd736a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:26.621557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4022025-b5eb-481a-8500-0cfc8ddd736a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:26.623787 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 17/32] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Sep 23 15:04:26 2022] POST /identity/v3/roles => generated 219 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:04:26.625078 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b15e4-a327-4328-802e-6783c58162b7 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:26.639522 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4022025-b5eb-481a-8500-0cfc8ddd736a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:26.642126 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4022025-b5eb-481a-8500-0cfc8ddd736a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:26.667374 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:26.667571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-e4022025-b5eb-481a-8500-0cfc8ddd736a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:04:26.667571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:26.667571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:26.667571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:26.667571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:26.667571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:26.667571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:26.667571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:26.667571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:26.667571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:26.667571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:26.667571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:26.667571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:04:26.667571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:04:26.667571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:04:26.667571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:04:26.668395 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:26.668395 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:26.668395 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:26.668395 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:26.668395 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:26.668395 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:26.668395 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:26.668395 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:26.668395 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:26.668395 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:26.668395 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:26.668395 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:26.668395 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:26.668395 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:26.668395 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:26.668395 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:26.668395 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:04:26.669202 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:04:26.669202 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:04:26.669202 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:04:26.669202 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 16/33] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:04:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:04:26.670150 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4022025-b5eb-481a-8500-0cfc8ddd736a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:26.795885 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b15e4-a327-4328-802e-6783c58162b7 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:26.804411 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4022025-b5eb-481a-8500-0cfc8ddd736a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:26.848059 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49036b-6b5d-4c68-bc37-cb7312381baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:26.848780 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49036b-6b5d-4c68-bc37-cb7312381baf None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:26.848989 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49036b-6b5d-4c68-bc37-cb7312381baf None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:26.849261 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49036b-6b5d-4c68-bc37-cb7312381baf None admin] PATH_INFO: `/v3/users/652ac5e448bf46d3bcf76749e06bdf9d` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:26.850137 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0975d97-0b71-4b9f-900a-0e917922799c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:26.850923 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49036b-6b5d-4c68-bc37-cb7312381baf None admin] RBAC: Authorizing `identity:get_user(user_id=652ac5e448bf46d3bcf76749e06bdf9d)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:26.851051 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0975d97-0b71-4b9f-900a-0e917922799c None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:26.851280 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0975d97-0b71-4b9f-900a-0e917922799c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:26.851660 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0975d97-0b71-4b9f-900a-0e917922799c None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:26.852470 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0975d97-0b71-4b9f-900a-0e917922799c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:26.852584 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49036b-6b5d-4c68-bc37-cb7312381baf None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:26.854071 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0975d97-0b71-4b9f-900a-0e917922799c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:26.854757 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 18/34] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:04:26 2022] GET /identity/v3/users/652ac5e448bf46d3bcf76749e06bdf9d => generated 247 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:26.855702 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49036b-6b5d-4c68-bc37-cb7312381baf None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:26.975245 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49036b-6b5d-4c68-bc37-cb7312381baf None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:26.977575 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:27.001239 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 17/35] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Sep 23 15:04:26 2022] POST /identity/v3/roles => generated 225 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:04:27.002835 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11962462-99de-485b-bd06-d458a903fff1 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:27.003121 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11962462-99de-485b-bd06-d458a903fff1 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:27.003398 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11962462-99de-485b-bd06-d458a903fff1 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:27.004679 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 18/36] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:27.009944 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11962462-99de-485b-bd06-d458a903fff1 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:27.015487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819388e-899e-4882-ade3-6488472c1808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:27.016148 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819388e-899e-4882-ade3-6488472c1808 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:27.016488 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819388e-899e-4882-ade3-6488472c1808 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:27.016769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819388e-899e-4882-ade3-6488472c1808 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:27.017442 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819388e-899e-4882-ade3-6488472c1808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:27.017802 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819388e-899e-4882-ade3-6488472c1808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:27.019262 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819388e-899e-4882-ade3-6488472c1808 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:27.036008 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 19/37] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:27.038130 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003e159-f5fa-4c66-bb2b-3fb52c0c7e9e None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:27.038433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003e159-f5fa-4c66-bb2b-3fb52c0c7e9e None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:27.038951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003e159-f5fa-4c66-bb2b-3fb52c0c7e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:27.059391 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-e003e159-f5fa-4c66-bb2b-3fb52c0c7e9e None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:27.059592 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:27.060947 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-e003e159-f5fa-4c66-bb2b-3fb52c0c7e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:27.130835 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11962462-99de-485b-bd06-d458a903fff1 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:27.136631 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 20/38] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:27.136631 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68237b-99e3-4cb1-82d2-436e32cca6a6 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:27.136631 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68237b-99e3-4cb1-82d2-436e32cca6a6 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:27.136631 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68237b-99e3-4cb1-82d2-436e32cca6a6 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:27.136631 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 21/39] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:27.136631 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68237b-99e3-4cb1-82d2-436e32cca6a6 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:27.184084 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0e24d-ea03-4289-a265-2b8ab20ca98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:27.184849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0e24d-ea03-4289-a265-2b8ab20ca98d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:27.185207 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0e24d-ea03-4289-a265-2b8ab20ca98d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:27.185554 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0e24d-ea03-4289-a265-2b8ab20ca98d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:27.186943 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0e24d-ea03-4289-a265-2b8ab20ca98d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:27.188700 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0e24d-ea03-4289-a265-2b8ab20ca98d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:27.190742 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 19/40] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:04:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:27.196656 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0fe13-3500-42bc-af92-4ad33b00211c None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:27.197008 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0fe13-3500-42bc-af92-4ad33b00211c None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:27.197360 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0fe13-3500-42bc-af92-4ad33b00211c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:27.217105 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-e9f0fe13-3500-42bc-af92-4ad33b00211c None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:27.218778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-e9f0fe13-3500-42bc-af92-4ad33b00211c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:27.261888 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:27.271256 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68237b-99e3-4cb1-82d2-436e32cca6a6 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:27.296412 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 20/41] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:27.297352 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0fe13-3500-42bc-af92-4ad33b00211c None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:27.306886 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc6c4d-58cc-46e5-a2b7-b35e31841803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:27.307729 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc6c4d-58cc-46e5-a2b7-b35e31841803 None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:27.308217 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc6c4d-58cc-46e5-a2b7-b35e31841803 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:27.308657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc6c4d-58cc-46e5-a2b7-b35e31841803 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:27.309512 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc6c4d-58cc-46e5-a2b7-b35e31841803 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:27.311275 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc6c4d-58cc-46e5-a2b7-b35e31841803 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:27.332714 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:27.352187 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 15:04:27 2022] POST /identity/v3/projects => generated 301 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:04:27.406866 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0fe13-3500-42bc-af92-4ad33b00211c None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:27.449982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c925c-23e7-493f-9f91-8bc0015ba197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:27.451183 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c925c-23e7-493f-9f91-8bc0015ba197 None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:27.451659 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c925c-23e7-493f-9f91-8bc0015ba197 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:27.452163 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c925c-23e7-493f-9f91-8bc0015ba197 None admin] PATH_INFO: `/v3/domains/default/users/652ac5e448bf46d3bcf76749e06bdf9d/roles/07d4069c848d4ee9abb586256ee26f20` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:27.455033 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c925c-23e7-493f-9f91-8bc0015ba197 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=652ac5e448bf46d3bcf76749e06bdf9d, role_id=07d4069c848d4ee9abb586256ee26f20)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:27.456618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c925c-23e7-493f-9f91-8bc0015ba197 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:27.456851 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc6c4d-58cc-46e5-a2b7-b35e31841803 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:27.479755 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 21/43] 10.222.0.48 () {58 vars in 1361 bytes} [Fri Sep 23 15:04:27 2022] PUT /identity/v3/domains/default/users/652ac5e448bf46d3bcf76749e06bdf9d/roles/07d4069c848d4ee9abb586256ee26f20 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:04:27.588584 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc6c4d-58cc-46e5-a2b7-b35e31841803 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:27.626078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c925c-23e7-493f-9f91-8bc0015ba197 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:27.628641 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8f51f-813e-42f7-a5ba-e9b57113cdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:27.629276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8f51f-813e-42f7-a5ba-e9b57113cdfd None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:27.629555 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8f51f-813e-42f7-a5ba-e9b57113cdfd None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:27.629941 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8f51f-813e-42f7-a5ba-e9b57113cdfd None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:27.630626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8f51f-813e-42f7-a5ba-e9b57113cdfd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:27.632034 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8f51f-813e-42f7-a5ba-e9b57113cdfd None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:27.648985 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Sep 23 15:04:27 2022] POST /identity/v3/roles => generated 223 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:04:27.753265 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:27.761202 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c925c-23e7-493f-9f91-8bc0015ba197 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:27.800914 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a709bb-556e-45cd-a274-89fb7e0aaa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:27.801575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a709bb-556e-45cd-a274-89fb7e0aaa0c None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:27.801906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a709bb-556e-45cd-a274-89fb7e0aaa0c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:27.802189 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a709bb-556e-45cd-a274-89fb7e0aaa0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:27.803354 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a709bb-556e-45cd-a274-89fb7e0aaa0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:27.804842 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a709bb-556e-45cd-a274-89fb7e0aaa0c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:27.806852 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 22/45] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:04:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:27.812439 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8f51f-813e-42f7-a5ba-e9b57113cdfd None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:27.823199 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:27.929876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8f51f-813e-42f7-a5ba-e9b57113cdfd None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:27.963465 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931e8b3-063d-4cd3-b175-767bd850013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:27.964116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931e8b3-063d-4cd3-b175-767bd850013a None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:27.964394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931e8b3-063d-4cd3-b175-767bd850013a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:27.964668 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931e8b3-063d-4cd3-b175-767bd850013a None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:27.965325 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931e8b3-063d-4cd3-b175-767bd850013a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:27.966829 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931e8b3-063d-4cd3-b175-767bd850013a None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:27.994458 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 15:04:27 2022] POST /identity/v3/projects => generated 312 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:04:29.919268 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c1ed2-312d-4fa5-a8e7-be26587cbb4c None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:29.919817 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c1ed2-312d-4fa5-a8e7-be26587cbb4c None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:29.919817 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c1ed2-312d-4fa5-a8e7-be26587cbb4c None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:29.921176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 23/47] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:29.927377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937fc9a-82c7-437c-a711-6d2418b085e5 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:29.927903 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937fc9a-82c7-437c-a711-6d2418b085e5 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:29.927903 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937fc9a-82c7-437c-a711-6d2418b085e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:29.952534 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-6937fc9a-82c7-437c-a711-6d2418b085e5 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:29.953787 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-6937fc9a-82c7-437c-a711-6d2418b085e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:30.010637 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:30.025303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 25/48] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:30.344531 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c1ed2-312d-4fa5-a8e7-be26587cbb4c None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:30.357100 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93b80d-2f05-4f04-b323-fcf7bc6ab807 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:30.357967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93b80d-2f05-4f04-b323-fcf7bc6ab807 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:30.358309 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93b80d-2f05-4f04-b323-fcf7bc6ab807 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:30.359963 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 26/49] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:30.365327 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e682fc6-98e3-41ee-a095-df1964bbdd34 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:30.365667 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e682fc6-98e3-41ee-a095-df1964bbdd34 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:30.366021 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e682fc6-98e3-41ee-a095-df1964bbdd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:30.383995 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-2e682fc6-98e3-41ee-a095-df1964bbdd34 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:30.385172 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-2e682fc6-98e3-41ee-a095-df1964bbdd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:30.447525 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c1ed2-312d-4fa5-a8e7-be26587cbb4c None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:30.450981 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 27/50] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:04:30.480165 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e65c9-9e5c-4001-a6df-439b80cf3484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:30.480800 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e65c9-9e5c-4001-a6df-439b80cf3484 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:30.481076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e65c9-9e5c-4001-a6df-439b80cf3484 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:30.481343 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e65c9-9e5c-4001-a6df-439b80cf3484 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:30.492048 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e65c9-9e5c-4001-a6df-439b80cf3484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:04:30.496887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-926e65c9-9e5c-4001-a6df-439b80cf3484 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:04:30.496887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:30.496887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:30.496887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:30.496887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:30.496887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:30.496887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:30.496887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:30.496887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:30.496887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:30.496887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:30.496887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:30.496887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:04:30.496887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:04:30.496887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:04:30.496887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:04:30.497965 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:04:30.497965 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:04:30.497965 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:04:30.497965 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:04:30.497965 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:30.497965 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:30.497965 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:30.497965 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:30.497965 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:30.497965 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:30.497965 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:30.497965 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:30.497965 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:30.497965 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:30.497965 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:30.497965 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:30.498773 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:30.498773 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:30.498773 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:30.498773 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:30.498773 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:04:30.498773 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:04:30.498773 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:04:30.498773 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:04:30.498773 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:04:30.498773 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:04:30.498773 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:04:30.498773 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:04:30.498773 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 24/51] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 15:04:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:04:30.503852 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e682fc6-98e3-41ee-a095-df1964bbdd34 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:30.606178 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e682fc6-98e3-41ee-a095-df1964bbdd34 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:30.624479 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:30.641992 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67a19f-155c-49a9-93ca-91b8fd42b76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:30.642591 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67a19f-155c-49a9-93ca-91b8fd42b76f None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:30.642868 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67a19f-155c-49a9-93ca-91b8fd42b76f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:30.643137 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67a19f-155c-49a9-93ca-91b8fd42b76f None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:30.643800 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67a19f-155c-49a9-93ca-91b8fd42b76f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:30.644101 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67a19f-155c-49a9-93ca-91b8fd42b76f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:30.645489 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67a19f-155c-49a9-93ca-91b8fd42b76f None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:30.656851 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 28/52] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:04:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:30.662753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e65c9-9e5c-4001-a6df-439b80cf3484 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:30.689610 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:30.763749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e65c9-9e5c-4001-a6df-439b80cf3484 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:30.772406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67a19f-155c-49a9-93ca-91b8fd42b76f None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:30.799829 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63238f39-0086-4f26-bfd9-9544d49a6a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:30.800524 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63238f39-0086-4f26-bfd9-9544d49a6a26 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:30.800801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63238f39-0086-4f26-bfd9-9544d49a6a26 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:30.801072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63238f39-0086-4f26-bfd9-9544d49a6a26 None admin] PATH_INFO: `/v3/users/652ac5e448bf46d3bcf76749e06bdf9d` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:30.802247 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63238f39-0086-4f26-bfd9-9544d49a6a26 None admin] RBAC: Authorizing `identity:get_user(user_id=652ac5e448bf46d3bcf76749e06bdf9d)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:30.803711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63238f39-0086-4f26-bfd9-9544d49a6a26 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:30.805296 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 25/53] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:04:30 2022] GET /identity/v3/users/652ac5e448bf46d3bcf76749e06bdf9d => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:30.810933 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63238f39-0086-4f26-bfd9-9544d49a6a26 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:30.874748 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67a19f-155c-49a9-93ca-91b8fd42b76f None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:30.904237 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:30.906771 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4ea4f-dd49-427a-a54a-783a37705589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:30.907463 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4ea4f-dd49-427a-a54a-783a37705589 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:30.907738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4ea4f-dd49-427a-a54a-783a37705589 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:30.908011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4ea4f-dd49-427a-a54a-783a37705589 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:30.909132 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4ea4f-dd49-427a-a54a-783a37705589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:30.910614 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4ea4f-dd49-427a-a54a-783a37705589 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:30.912178 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 29/54] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:04:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:30.913498 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63238f39-0086-4f26-bfd9-9544d49a6a26 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:30.917747 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4ea4f-dd49-427a-a54a-783a37705589 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:30.947520 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9f91f-5308-46ce-aae5-d95d78a4e016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:30.948154 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9f91f-5308-46ce-aae5-d95d78a4e016 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:30.948435 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9f91f-5308-46ce-aae5-d95d78a4e016 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:30.948708 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9f91f-5308-46ce-aae5-d95d78a4e016 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:30.949859 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9f91f-5308-46ce-aae5-d95d78a4e016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:30.951316 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9f91f-5308-46ce-aae5-d95d78a4e016 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:30.952891 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 26/55] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:04:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:30.958599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9f91f-5308-46ce-aae5-d95d78a4e016 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:30.964725 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:31.016314 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4ea4f-dd49-427a-a54a-783a37705589 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:31.047827 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e79746-23ae-4d07-8e72-116f9874ad1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:31.048435 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e79746-23ae-4d07-8e72-116f9874ad1d None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:31.048718 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e79746-23ae-4d07-8e72-116f9874ad1d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:31.048994 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e79746-23ae-4d07-8e72-116f9874ad1d None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:31.049672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e79746-23ae-4d07-8e72-116f9874ad1d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:31.051150 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e79746-23ae-4d07-8e72-116f9874ad1d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:31.053291 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9f91f-5308-46ce-aae5-d95d78a4e016 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:31.078593 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 30/56] 10.222.0.48 () {60 vars in 1140 bytes} [Fri Sep 23 15:04:30 2022] POST /identity/v3/projects => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:04:31.087466 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269afc16-deb1-47a8-80be-2f91c75597fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:31.088102 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269afc16-deb1-47a8-80be-2f91c75597fc None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:31.088482 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269afc16-deb1-47a8-80be-2f91c75597fc None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:31.088764 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269afc16-deb1-47a8-80be-2f91c75597fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:31.089533 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269afc16-deb1-47a8-80be-2f91c75597fc None admin] RBAC: Adding query filter params (role.id=07d4069c848d4ee9abb586256ee26f20, scope.domain.id=default, user.id=652ac5e448bf46d3bcf76749e06bdf9d) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:31.089914 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269afc16-deb1-47a8-80be-2f91c75597fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:31.091372 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269afc16-deb1-47a8-80be-2f91c75597fc None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:31.098353 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 27/57] 10.222.0.48 () {56 vars in 1322 bytes} [Fri Sep 23 15:04:30 2022] GET /identity/v3/role_assignments?user.id=652ac5e448bf46d3bcf76749e06bdf9d&scope.domain.id=default&role.id=07d4069c848d4ee9abb586256ee26f20 => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:04:33.502873 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327578b-0df1-4da9-90a2-90e0c29939bf None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:33.503702 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327578b-0df1-4da9-90a2-90e0c29939bf None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:33.503702 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327578b-0df1-4da9-90a2-90e0c29939bf None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:33.505922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 31/58] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:33.511997 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f620444-9587-4265-bbef-ee5304c78cb7 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:33.512409 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f620444-9587-4265-bbef-ee5304c78cb7 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:33.512592 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f620444-9587-4265-bbef-ee5304c78cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:33.536653 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-1f620444-9587-4265-bbef-ee5304c78cb7 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:33.537889 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-1f620444-9587-4265-bbef-ee5304c78cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:33.557382 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:33.610231 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 28/59] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:33.925459 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327578b-0df1-4da9-90a2-90e0c29939bf None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:34.026451 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:34.033849 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327578b-0df1-4da9-90a2-90e0c29939bf None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:34.075441 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ba1b3-3fd3-405d-997a-725ac7f02222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:34.076098 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ba1b3-3fd3-405d-997a-725ac7f02222 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:34.076381 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ba1b3-3fd3-405d-997a-725ac7f02222 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:34.076653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ba1b3-3fd3-405d-997a-725ac7f02222 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:34.077868 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ba1b3-3fd3-405d-997a-725ac7f02222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:34.079341 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ba1b3-3fd3-405d-997a-725ac7f02222 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:34.080892 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 32/60] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:04:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:34.086722 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f620444-9587-4265-bbef-ee5304c78cb7 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:34.192959 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f620444-9587-4265-bbef-ee5304c78cb7 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:34.228714 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0112c-f3eb-4d53-be42-7a8440a90f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:34.229313 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0112c-f3eb-4d53-be42-7a8440a90f04 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:34.229592 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0112c-f3eb-4d53-be42-7a8440a90f04 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:34.229898 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0112c-f3eb-4d53-be42-7a8440a90f04 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:34.230544 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0112c-f3eb-4d53-be42-7a8440a90f04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:34.232325 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0112c-f3eb-4d53-be42-7a8440a90f04 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:34.262003 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 29/61] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 15:04:34 2022] POST /identity/v3/users => generated 275 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:04:37.937413 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3d92b-d551-4724-963d-2244d7c12a1c None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:37.937413 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3d92b-d551-4724-963d-2244d7c12a1c None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:37.937413 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3d92b-d551-4724-963d-2244d7c12a1c None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:37.937413 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 33/62] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:37.943057 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471599ce-4be7-4266-932a-9aa52741fa3e None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:37.943953 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471599ce-4be7-4266-932a-9aa52741fa3e None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:37.944439 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471599ce-4be7-4266-932a-9aa52741fa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:37.974792 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-471599ce-4be7-4266-932a-9aa52741fa3e None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:37.976300 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-471599ce-4be7-4266-932a-9aa52741fa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:37.979695 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:38.021643 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36978bdb-2841-4c54-a4c5-a5ae5594326e None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:38.021973 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36978bdb-2841-4c54-a4c5-a5ae5594326e None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:38.022231 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36978bdb-2841-4c54-a4c5-a5ae5594326e None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:38.023574 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 34/63] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:04:38.038341 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd068321-f6ef-4722-9f3c-30206859cb1c None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:38.038659 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd068321-f6ef-4722-9f3c-30206859cb1c None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:38.038898 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd068321-f6ef-4722-9f3c-30206859cb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:38.070104 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 30/64] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:38.074829 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-cd068321-f6ef-4722-9f3c-30206859cb1c None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:38.076304 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-cd068321-f6ef-4722-9f3c-30206859cb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:38.130138 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16da67-24f2-4185-95c2-3fc31578d7bd None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:38.130764 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16da67-24f2-4185-95c2-3fc31578d7bd None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:38.131238 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16da67-24f2-4185-95c2-3fc31578d7bd None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:38.132771 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 31/65] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:04:38.138158 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a1a3b-9a65-434e-924d-4ec2942f2160 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:38.138771 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a1a3b-9a65-434e-924d-4ec2942f2160 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:38.139245 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a1a3b-9a65-434e-924d-4ec2942f2160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:38.157458 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-354a1a3b-9a65-434e-924d-4ec2942f2160 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:38.159015 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-354a1a3b-9a65-434e-924d-4ec2942f2160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:38.211005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 35/66] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:04:38.227440 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 32/67] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:04:38.399761 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a6e0a-ef3f-4950-b23d-156ddc8bfa74 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:38.400124 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a6e0a-ef3f-4950-b23d-156ddc8bfa74 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:38.400319 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a6e0a-ef3f-4950-b23d-156ddc8bfa74 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:38.401678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 36/68] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:38.407127 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f929b02-018b-4bbf-87dc-29d1ca684010 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:38.407731 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f929b02-018b-4bbf-87dc-29d1ca684010 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:38.408191 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f929b02-018b-4bbf-87dc-29d1ca684010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:38.411133 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a6e0a-ef3f-4950-b23d-156ddc8bfa74 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:38.433169 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-9f929b02-018b-4bbf-87dc-29d1ca684010 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:38.434815 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-9f929b02-018b-4bbf-87dc-29d1ca684010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:38.510809 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:38.519609 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 33/69] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:38.542102 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:38.545523 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a6e0a-ef3f-4950-b23d-156ddc8bfa74 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:38.580944 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d92051-4954-4ccc-9c96-ba391f175055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:38.581935 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d92051-4954-4ccc-9c96-ba391f175055 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:38.582427 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d92051-4954-4ccc-9c96-ba391f175055 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:38.582878 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d92051-4954-4ccc-9c96-ba391f175055 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:38.594247 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d92051-4954-4ccc-9c96-ba391f175055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:04:38.601752 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-72d92051-4954-4ccc-9c96-ba391f175055 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:04:38.601752 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:38.601752 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:38.601752 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:38.601752 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:38.601752 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:38.601752 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:38.601752 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:38.601752 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:38.601752 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:38.601752 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:38.601752 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:38.601752 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:04:38.601752 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:04:38.601752 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:04:38.601752 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:04:38.602704 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:04:38.602704 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:04:38.602704 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:04:38.602704 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:04:38.602704 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:38.602704 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:38.602704 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:38.602704 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:38.602704 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:38.602704 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:38.602704 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:38.602704 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:38.602704 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:38.602704 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:38.602704 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:38.602704 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:38.603466 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:38.603466 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:38.603466 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:38.603466 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:38.603466 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:04:38.603466 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:04:38.603466 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:04:38.603466 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:04:38.603466 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:04:38.603466 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:04:38.603466 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:04:38.603466 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:04:38.605666 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 37/70] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 15:04:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:04:38.614853 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f929b02-018b-4bbf-87dc-29d1ca684010 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:38.624595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d92051-4954-4ccc-9c96-ba391f175055 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:38.749021 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d92051-4954-4ccc-9c96-ba391f175055 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:38.757841 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f929b02-018b-4bbf-87dc-29d1ca684010 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:38.791795 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2554c-1159-4d0b-b4f4-61b52b6d4256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:38.792367 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2554c-1159-4d0b-b4f4-61b52b6d4256 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:38.792643 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2554c-1159-4d0b-b4f4-61b52b6d4256 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:38.792736 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b52d9-6c2c-4f90-83a3-0a18f77cb05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:38.792906 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2554c-1159-4d0b-b4f4-61b52b6d4256 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:38.793367 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b52d9-6c2c-4f90-83a3-0a18f77cb05a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:38.793648 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b52d9-6c2c-4f90-83a3-0a18f77cb05a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:38.793967 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b52d9-6c2c-4f90-83a3-0a18f77cb05a None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:38.794644 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b52d9-6c2c-4f90-83a3-0a18f77cb05a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:38.794949 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b52d9-6c2c-4f90-83a3-0a18f77cb05a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:38.796376 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b52d9-6c2c-4f90-83a3-0a18f77cb05a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:38.804005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2554c-1159-4d0b-b4f4-61b52b6d4256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:04:38.809172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 34/71] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:04:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:38.809172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7692dd-babf-4f81-9a88-d8b8898d26b5 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:38.809172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7692dd-babf-4f81-9a88-d8b8898d26b5 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:38.809172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7692dd-babf-4f81-9a88-d8b8898d26b5 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:38.809172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 35/72] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:38.809525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-b8b2554c-1159-4d0b-b4f4-61b52b6d4256 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:04:38.809525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:38.809525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:38.809525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:38.809525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:38.809525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:38.809525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:38.809525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:38.809525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:38.809525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:38.809525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:38.809525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:38.809525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:04:38.809525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:04:38.809525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:04:38.809525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:04:38.810343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:04:38.810343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:04:38.810343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:04:38.810343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:04:38.810343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:38.810343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:38.810343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:38.810343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:38.810343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:38.810343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:38.810343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:38.810343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:38.810343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:38.810343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:38.810343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:38.810343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:38.812441 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:38.812441 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:38.812441 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:38.812441 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:38.812441 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:04:38.812441 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:04:38.812441 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:04:38.812441 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:04:38.812441 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:04:38.812441 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:04:38.812441 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:04:38.812441 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:04:38.812441 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 38/73] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 15:04:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:04:38.813077 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7692dd-babf-4f81-9a88-d8b8898d26b5 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:38.813160 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2554c-1159-4d0b-b4f4-61b52b6d4256 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:38.833658 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:38.877924 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:38.918134 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7692dd-babf-4f81-9a88-d8b8898d26b5 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:38.919758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2554c-1159-4d0b-b4f4-61b52b6d4256 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:38.950263 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23a40a-725f-40e9-8ba7-c6d32e529dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:38.950891 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23a40a-725f-40e9-8ba7-c6d32e529dab None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:38.951165 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23a40a-725f-40e9-8ba7-c6d32e529dab None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:38.951434 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23a40a-725f-40e9-8ba7-c6d32e529dab None admin] PATH_INFO: `/v3/roles/member` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:38.952077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a34ab9-7d51-4584-8c27-0c090e28c34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:38.952709 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a34ab9-7d51-4584-8c27-0c090e28c34f None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:38.952997 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a34ab9-7d51-4584-8c27-0c090e28c34f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:38.953430 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a34ab9-7d51-4584-8c27-0c090e28c34f None admin] PATH_INFO: `/v3/users/652ac5e448bf46d3bcf76749e06bdf9d` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:38.954584 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a34ab9-7d51-4584-8c27-0c090e28c34f None admin] RBAC: Authorizing `identity:get_user(user_id=652ac5e448bf46d3bcf76749e06bdf9d)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:38.956062 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a34ab9-7d51-4584-8c27-0c090e28c34f None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:38.957634 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 39/74] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:04:38 2022] GET /identity/v3/users/652ac5e448bf46d3bcf76749e06bdf9d => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:38.962430 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664f6b1-2617-4cdc-bf29-96b33cf0acce None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:38.962430 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664f6b1-2617-4cdc-bf29-96b33cf0acce None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:38.962430 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664f6b1-2617-4cdc-bf29-96b33cf0acce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:38.966407 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23a40a-725f-40e9-8ba7-c6d32e529dab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:04:38.971828 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-bc23a40a-725f-40e9-8ba7-c6d32e529dab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:04:38.971828 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:38.971828 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:38.971828 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:38.971828 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:38.971828 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:38.971828 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:38.971828 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:38.971828 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:38.971828 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:38.971828 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:38.971828 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:38.971828 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:04:38.971828 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:04:38.971828 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:04:38.971828 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:04:38.972666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:04:38.972666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:04:38.972666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:04:38.972666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:04:38.972666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:38.972666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:38.972666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:38.972666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:38.972666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:38.972666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:38.972666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:38.972666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:38.972666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:38.972666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:38.972666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:38.972666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:38.973431 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:38.973431 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:38.973431 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:38.973431 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:38.973431 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:04:38.973431 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:04:38.973431 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:04:38.973431 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:04:38.973431 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:04:38.973431 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:04:38.973431 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:04:38.973431 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:04:38.973431 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 36/75] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:04:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:04:38.974266 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23a40a-725f-40e9-8ba7-c6d32e529dab None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:38.976828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-4664f6b1-2617-4cdc-bf29-96b33cf0acce None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:38.978108 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-4664f6b1-2617-4cdc-bf29-96b33cf0acce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:39.053723 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 40/76] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:39.053723 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664f6b1-2617-4cdc-bf29-96b33cf0acce None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:39.071332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23a40a-725f-40e9-8ba7-c6d32e529dab None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:39.071596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:39.093673 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:39.105872 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7c7aa-ddcd-49f3-9eff-0873380e61e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:39.106915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7c7aa-ddcd-49f3-9eff-0873380e61e4 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:39.107268 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7c7aa-ddcd-49f3-9eff-0873380e61e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:39.107610 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7c7aa-ddcd-49f3-9eff-0873380e61e4 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:39.108354 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7c7aa-ddcd-49f3-9eff-0873380e61e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:39.108735 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7c7aa-ddcd-49f3-9eff-0873380e61e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:39.110236 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7c7aa-ddcd-49f3-9eff-0873380e61e4 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:39.118531 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 37/77] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:04:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:39.123673 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7c7aa-ddcd-49f3-9eff-0873380e61e4 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:39.156785 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664f6b1-2617-4cdc-bf29-96b33cf0acce None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:39.191624 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1828b-f1fe-4453-9c35-190f6998ad8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:39.192253 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1828b-f1fe-4453-9c35-190f6998ad8f None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:39.192530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1828b-f1fe-4453-9c35-190f6998ad8f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:39.192820 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1828b-f1fe-4453-9c35-190f6998ad8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:39.203026 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1828b-f1fe-4453-9c35-190f6998ad8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:04:39.207735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-3fc1828b-f1fe-4453-9c35-190f6998ad8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:04:39.207735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:39.207735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:39.207735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:39.207735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:39.207735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:39.207735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:39.207735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:39.207735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:39.207735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:39.207735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:39.207735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:39.207735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:04:39.207735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:04:39.207735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:04:39.207735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:04:39.208642 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:04:39.208642 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:04:39.208642 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:04:39.208642 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:04:39.208642 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:39.208642 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:39.208642 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:39.208642 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:39.208642 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:39.208642 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:39.208642 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:39.208642 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:39.208642 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:39.208642 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:39.208642 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:39.208642 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:39.209424 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:39.209424 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:39.209424 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:39.209424 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:39.209424 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:04:39.209424 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:04:39.209424 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:04:39.209424 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:04:39.209424 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:04:39.209424 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:04:39.209424 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:04:39.209424 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:04:39.209424 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 41/78] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:04:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:04:39.210078 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1828b-f1fe-4453-9c35-190f6998ad8f None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:39.230773 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7c7aa-ddcd-49f3-9eff-0873380e61e4 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:39.265310 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025aec0-242a-4e23-ace4-b7535c078c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:39.265964 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025aec0-242a-4e23-ace4-b7535c078c68 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:39.266249 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025aec0-242a-4e23-ace4-b7535c078c68 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:39.266524 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025aec0-242a-4e23-ace4-b7535c078c68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:39.291394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:39.315983 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1828b-f1fe-4453-9c35-190f6998ad8f None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:39.320674 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:39.337641 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025aec0-242a-4e23-ace4-b7535c078c68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:39.339546 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025aec0-242a-4e23-ace4-b7535c078c68 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:39.353428 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee7e64-f1f8-455e-bd80-05f5ba7c6ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:39.354633 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee7e64-f1f8-455e-bd80-05f5ba7c6ae7 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:39.355061 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee7e64-f1f8-455e-bd80-05f5ba7c6ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:39.355497 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee7e64-f1f8-455e-bd80-05f5ba7c6ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:39.356296 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee7e64-f1f8-455e-bd80-05f5ba7c6ae7 None admin] RBAC: Adding query filter params (name=member) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:39.357068 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee7e64-f1f8-455e-bd80-05f5ba7c6ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:39.358670 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee7e64-f1f8-455e-bd80-05f5ba7c6ae7 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:39.366960 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 42/79] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:04:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:39.367797 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee7e64-f1f8-455e-bd80-05f5ba7c6ae7 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:39.441001 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 38/80] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:04:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:04:39.441880 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025aec0-242a-4e23-ace4-b7535c078c68 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:39.467543 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee7e64-f1f8-455e-bd80-05f5ba7c6ae7 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:39.500735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e886d-dff5-4af7-ba2a-cab16eed3400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:39.501364 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e886d-dff5-4af7-ba2a-cab16eed3400 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:39.501639 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e886d-dff5-4af7-ba2a-cab16eed3400 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:39.501941 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e886d-dff5-4af7-ba2a-cab16eed3400 None admin] PATH_INFO: `/v3/users/5b5fc9396faf4a98b542619453683e4f` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:39.509428 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:39.517067 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e886d-dff5-4af7-ba2a-cab16eed3400 None admin] RBAC: Authorizing `identity:get_user(user_id=5b5fc9396faf4a98b542619453683e4f)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:39.518572 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e886d-dff5-4af7-ba2a-cab16eed3400 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:39.520174 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 43/81] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:04:39 2022] GET /identity/v3/users/5b5fc9396faf4a98b542619453683e4f => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:39.520925 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e886d-dff5-4af7-ba2a-cab16eed3400 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:39.525490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:39.540409 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025aec0-242a-4e23-ace4-b7535c078c68 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:39.573481 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356ca1f-95db-495a-bd56-1b994cbdd53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:39.574058 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356ca1f-95db-495a-bd56-1b994cbdd53d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:39.574337 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356ca1f-95db-495a-bd56-1b994cbdd53d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:39.574613 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356ca1f-95db-495a-bd56-1b994cbdd53d None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:39.575246 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356ca1f-95db-495a-bd56-1b994cbdd53d None admin] RBAC: Adding query filter params (name=member) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:39.575549 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356ca1f-95db-495a-bd56-1b994cbdd53d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:39.576918 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356ca1f-95db-495a-bd56-1b994cbdd53d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:39.584710 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 39/82] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:04:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:39.585494 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356ca1f-95db-495a-bd56-1b994cbdd53d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:39.618796 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e886d-dff5-4af7-ba2a-cab16eed3400 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:39.652905 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305035c-cc2e-4e90-897b-c2a15c153437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:39.653532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305035c-cc2e-4e90-897b-c2a15c153437 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:39.653847 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305035c-cc2e-4e90-897b-c2a15c153437 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:39.654116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305035c-cc2e-4e90-897b-c2a15c153437 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:39.655304 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305035c-cc2e-4e90-897b-c2a15c153437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:39.656741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305035c-cc2e-4e90-897b-c2a15c153437 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:39.658501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 44/83] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:04:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:39.659131 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305035c-cc2e-4e90-897b-c2a15c153437 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:39.686125 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356ca1f-95db-495a-bd56-1b994cbdd53d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:39.718719 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd28a09-5b46-4aa6-a40b-e3c4b1d89acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:39.719627 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd28a09-5b46-4aa6-a40b-e3c4b1d89acb None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:39.719913 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd28a09-5b46-4aa6-a40b-e3c4b1d89acb None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:39.720186 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd28a09-5b46-4aa6-a40b-e3c4b1d89acb None admin] PATH_INFO: `/v3/users/5b5fc9396faf4a98b542619453683e4f` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:39.721305 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd28a09-5b46-4aa6-a40b-e3c4b1d89acb None admin] RBAC: Authorizing `identity:get_user(user_id=5b5fc9396faf4a98b542619453683e4f)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:39.722804 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd28a09-5b46-4aa6-a40b-e3c4b1d89acb None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:39.723087 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:39.724635 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 40/84] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:04:39 2022] GET /identity/v3/users/5b5fc9396faf4a98b542619453683e4f => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:39.726851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd28a09-5b46-4aa6-a40b-e3c4b1d89acb None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:39.742607 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:39.760835 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305035c-cc2e-4e90-897b-c2a15c153437 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:39.794589 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e66701-0bf5-4c4f-92d2-cceffdd7c472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:39.795232 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e66701-0bf5-4c4f-92d2-cceffdd7c472 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:39.795510 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e66701-0bf5-4c4f-92d2-cceffdd7c472 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:39.795823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e66701-0bf5-4c4f-92d2-cceffdd7c472 None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:39.796952 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e66701-0bf5-4c4f-92d2-cceffdd7c472 None admin] RBAC: Authorizing `identity:get_project(project_id=f366603e9ef2405c82fc9fb4c82d1ba0)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:39.798455 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e66701-0bf5-4c4f-92d2-cceffdd7c472 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:39.800273 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 45/85] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:04:39 2022] GET /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:39.800816 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e66701-0bf5-4c4f-92d2-cceffdd7c472 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:39.826349 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd28a09-5b46-4aa6-a40b-e3c4b1d89acb None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:39.859934 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e25fb-d4d2-4b53-9b5a-9c0c8aa68197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:39.860554 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e25fb-d4d2-4b53-9b5a-9c0c8aa68197 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:39.860840 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e25fb-d4d2-4b53-9b5a-9c0c8aa68197 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:39.861116 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e25fb-d4d2-4b53-9b5a-9c0c8aa68197 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:39.896570 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e66701-0bf5-4c4f-92d2-cceffdd7c472 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:39.925128 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:39.928845 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e25fb-d4d2-4b53-9b5a-9c0c8aa68197 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:39.930394 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e25fb-d4d2-4b53-9b5a-9c0c8aa68197 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:39.930673 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e02184-b894-4c66-beed-8a515bdbdb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:39.931343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e02184-b894-4c66-beed-8a515bdbdb52 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:39.931622 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e02184-b894-4c66-beed-8a515bdbdb52 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:39.931893 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e02184-b894-4c66-beed-8a515bdbdb52 None admin] PATH_INFO: `/v3/users/5b5fc9396faf4a98b542619453683e4f` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:39.933066 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e02184-b894-4c66-beed-8a515bdbdb52 None admin] RBAC: Authorizing `identity:get_user(user_id=5b5fc9396faf4a98b542619453683e4f)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:39.934530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e02184-b894-4c66-beed-8a515bdbdb52 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:39.936103 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 46/86] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:04:39 2022] GET /identity/v3/users/5b5fc9396faf4a98b542619453683e4f => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:39.936831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e02184-b894-4c66-beed-8a515bdbdb52 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:39.945674 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:40.032053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 41/87] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:04:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:04:40.037011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e02184-b894-4c66-beed-8a515bdbdb52 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:40.037494 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e25fb-d4d2-4b53-9b5a-9c0c8aa68197 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:40.070755 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3e3f1-e70a-4692-b66c-c3c4b4d83e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:40.071416 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3e3f1-e70a-4692-b66c-c3c4b4d83e3b None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:40.071689 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3e3f1-e70a-4692-b66c-c3c4b4d83e3b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:40.071954 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3e3f1-e70a-4692-b66c-c3c4b4d83e3b None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:40.072596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3e3f1-e70a-4692-b66c-c3c4b4d83e3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:40.074074 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3e3f1-e70a-4692-b66c-c3c4b4d83e3b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:40.101833 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 47/88] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 15:04:39 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:04:40.102634 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3e3f1-e70a-4692-b66c-c3c4b4d83e3b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:40.148177 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e25fb-d4d2-4b53-9b5a-9c0c8aa68197 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:40.164360 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:40.170236 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:40.191854 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c34cf8-5731-4360-9e07-5b74b262f630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:40.192482 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c34cf8-5731-4360-9e07-5b74b262f630 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:40.192757 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c34cf8-5731-4360-9e07-5b74b262f630 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:40.193563 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c34cf8-5731-4360-9e07-5b74b262f630 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:40.221219 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3e3f1-e70a-4692-b66c-c3c4b4d83e3b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:40.258867 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6d053-5e37-4a36-90a4-f105dbb39e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:40.259802 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6d053-5e37-4a36-90a4-f105dbb39e5e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:40.260279 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6d053-5e37-4a36-90a4-f105dbb39e5e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:40.260716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6d053-5e37-4a36-90a4-f105dbb39e5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:40.261618 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6d053-5e37-4a36-90a4-f105dbb39e5e None admin] RBAC: Adding query filter params (role.id=07d4069c848d4ee9abb586256ee26f20, scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0, user.id=652ac5e448bf46d3bcf76749e06bdf9d) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:40.262142 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6d053-5e37-4a36-90a4-f105dbb39e5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:40.263784 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6d053-5e37-4a36-90a4-f105dbb39e5e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:40.271622 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c34cf8-5731-4360-9e07-5b74b262f630 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:40.273063 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 48/89] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:04:40 2022] GET /identity/v3/role_assignments?user.id=652ac5e448bf46d3bcf76749e06bdf9d&scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0&role.id=07d4069c848d4ee9abb586256ee26f20 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:40.273167 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c34cf8-5731-4360-9e07-5b74b262f630 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:40.274342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6d053-5e37-4a36-90a4-f105dbb39e5e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:40.410465 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 42/90] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:04:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:04:40.411082 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c34cf8-5731-4360-9e07-5b74b262f630 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:40.418368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6d053-5e37-4a36-90a4-f105dbb39e5e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:40.427847 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:40.445504 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:40.461743 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a86753-4c94-44b7-b4dd-be89bdd8289c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:40.462388 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a86753-4c94-44b7-b4dd-be89bdd8289c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:40.462673 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a86753-4c94-44b7-b4dd-be89bdd8289c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:40.462948 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a86753-4c94-44b7-b4dd-be89bdd8289c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:40.562150 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c34cf8-5731-4360-9e07-5b74b262f630 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:40.563227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a86753-4c94-44b7-b4dd-be89bdd8289c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:40.564736 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a86753-4c94-44b7-b4dd-be89bdd8289c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:40.617302 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d40e8-4212-4be1-b395-4188b09950b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:40.618579 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d40e8-4212-4be1-b395-4188b09950b4 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:40.619258 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d40e8-4212-4be1-b395-4188b09950b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:40.619704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d40e8-4212-4be1-b395-4188b09950b4 None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:40.621427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d40e8-4212-4be1-b395-4188b09950b4 None admin] RBAC: Authorizing `identity:get_project(project_id=f366603e9ef2405c82fc9fb4c82d1ba0)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:40.623117 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d40e8-4212-4be1-b395-4188b09950b4 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:40.625832 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 43/91] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:04:40 2022] GET /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:40.627041 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d40e8-4212-4be1-b395-4188b09950b4 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:40.682339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 49/92] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:04:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:04:40.683508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a86753-4c94-44b7-b4dd-be89bdd8289c None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:40.708879 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:40.747623 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:40.791074 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d40e8-4212-4be1-b395-4188b09950b4 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:40.795989 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a86753-4c94-44b7-b4dd-be89bdd8289c None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:40.831667 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946b4e3-2556-40b6-b58f-1cf84d06c6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:40.832322 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946b4e3-2556-40b6-b58f-1cf84d06c6ba None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:40.832608 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946b4e3-2556-40b6-b58f-1cf84d06c6ba None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:40.832886 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946b4e3-2556-40b6-b58f-1cf84d06c6ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:40.833621 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946b4e3-2556-40b6-b58f-1cf84d06c6ba None admin] RBAC: Adding query filter params (role.id=877977a662dd49daab1ee42ba834153e, scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0, user.id=5b5fc9396faf4a98b542619453683e4f) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:40.833970 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946b4e3-2556-40b6-b58f-1cf84d06c6ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:40.835453 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946b4e3-2556-40b6-b58f-1cf84d06c6ba None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:40.842121 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 50/93] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:04:40 2022] GET /identity/v3/role_assignments?user.id=5b5fc9396faf4a98b542619453683e4f&scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0&role.id=877977a662dd49daab1ee42ba834153e => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:40.842922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946b4e3-2556-40b6-b58f-1cf84d06c6ba None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:40.891795 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75aa85b-e34d-43d6-8058-57ae326ba639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:40.892726 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75aa85b-e34d-43d6-8058-57ae326ba639 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:40.893138 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75aa85b-e34d-43d6-8058-57ae326ba639 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:40.893538 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75aa85b-e34d-43d6-8058-57ae326ba639 None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:40.895211 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75aa85b-e34d-43d6-8058-57ae326ba639 None admin] RBAC: Authorizing `identity:get_project(project_id=f366603e9ef2405c82fc9fb4c82d1ba0)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:40.897527 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75aa85b-e34d-43d6-8058-57ae326ba639 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:40.906861 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 44/94] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:04:40 2022] GET /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:40.922094 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75aa85b-e34d-43d6-8058-57ae326ba639 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:40.951260 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:40.968767 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946b4e3-2556-40b6-b58f-1cf84d06c6ba None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:41.008787 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d35afe-a7fa-4865-adef-eeaf39094cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:41.009445 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d35afe-a7fa-4865-adef-eeaf39094cf0 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:41.009758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d35afe-a7fa-4865-adef-eeaf39094cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:41.010044 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d35afe-a7fa-4865-adef-eeaf39094cf0 None admin] PATH_INFO: `/v3/projects/38e8da47d3244110b70ec8fb9cccb880` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:41.011875 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d35afe-a7fa-4865-adef-eeaf39094cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=38e8da47d3244110b70ec8fb9cccb880)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:41.013362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d35afe-a7fa-4865-adef-eeaf39094cf0 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:41.015424 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 51/95] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:04:40 2022] GET /identity/v3/projects/38e8da47d3244110b70ec8fb9cccb880 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:41.021298 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d35afe-a7fa-4865-adef-eeaf39094cf0 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:41.133490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75aa85b-e34d-43d6-8058-57ae326ba639 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:41.168725 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a65fc-0347-4b8e-921f-5538f37ff7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:41.169350 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a65fc-0347-4b8e-921f-5538f37ff7c4 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:41.169624 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a65fc-0347-4b8e-921f-5538f37ff7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:41.169942 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a65fc-0347-4b8e-921f-5538f37ff7c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:41.170414 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d35afe-a7fa-4865-adef-eeaf39094cf0 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:41.170841 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a65fc-0347-4b8e-921f-5538f37ff7c4 None admin] RBAC: Adding query filter params (role.id=dfd00108a3dd42f1a9dd0335f4b8f508, scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0, user.id=5b5fc9396faf4a98b542619453683e4f) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:41.170997 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a65fc-0347-4b8e-921f-5538f37ff7c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:41.172394 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a65fc-0347-4b8e-921f-5538f37ff7c4 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:41.178818 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 45/96] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:04:40 2022] GET /identity/v3/role_assignments?user.id=5b5fc9396faf4a98b542619453683e4f&scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0&role.id=dfd00108a3dd42f1a9dd0335f4b8f508 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:41.229828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a401fb-6cc6-4ab5-a90b-be43a5a62a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:41.230387 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a401fb-6cc6-4ab5-a90b-be43a5a62a3b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:41.230665 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a401fb-6cc6-4ab5-a90b-be43a5a62a3b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:41.230941 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a401fb-6cc6-4ab5-a90b-be43a5a62a3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:41.232004 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a401fb-6cc6-4ab5-a90b-be43a5a62a3b None admin] RBAC: Adding query filter params (role.id=dfd00108a3dd42f1a9dd0335f4b8f508, scope.project.id=38e8da47d3244110b70ec8fb9cccb880, user.id=5b5fc9396faf4a98b542619453683e4f) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:41.232314 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a401fb-6cc6-4ab5-a90b-be43a5a62a3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:41.233789 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a401fb-6cc6-4ab5-a90b-be43a5a62a3b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:41.240163 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 52/97] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:04:41 2022] GET /identity/v3/role_assignments?user.id=5b5fc9396faf4a98b542619453683e4f&scope.project.id=38e8da47d3244110b70ec8fb9cccb880&role.id=dfd00108a3dd42f1a9dd0335f4b8f508 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:04:43.221972 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ffab5-847a-47e2-8542-b2726b6796d4 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:43.222993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ffab5-847a-47e2-8542-b2726b6796d4 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:43.223478 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ffab5-847a-47e2-8542-b2726b6796d4 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:43.225061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 46/98] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:43.230655 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9d4d7-cd9e-4a06-9d1e-7e9d7d1452b4 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:43.231440 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9d4d7-cd9e-4a06-9d1e-7e9d7d1452b4 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:43.232212 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9d4d7-cd9e-4a06-9d1e-7e9d7d1452b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:43.254931 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-57a9d4d7-cd9e-4a06-9d1e-7e9d7d1452b4 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:43.256476 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-57a9d4d7-cd9e-4a06-9d1e-7e9d7d1452b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:43.272138 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:43.296289 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c459ab-00b8-45c3-addd-7fd29a42b243 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:43.296600 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c459ab-00b8-45c3-addd-7fd29a42b243 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:43.296846 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c459ab-00b8-45c3-addd-7fd29a42b243 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:43.298402 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 47/99] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:43.307235 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbf079-45d7-41de-8d05-4dc7dc60bf29 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:43.307518 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbf079-45d7-41de-8d05-4dc7dc60bf29 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:43.307796 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbf079-45d7-41de-8d05-4dc7dc60bf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:43.334633 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-e4cbf079-45d7-41de-8d05-4dc7dc60bf29 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:43.335849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-e4cbf079-45d7-41de-8d05-4dc7dc60bf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:43.355733 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:43.378792 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 53/100] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:43.433079 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 48/101] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:04:43.814276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9d4d7-cd9e-4a06-9d1e-7e9d7d1452b4 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:43.930335 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9d4d7-cd9e-4a06-9d1e-7e9d7d1452b4 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:43.975325 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7355b-2918-4214-8a68-5d43e2457630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:43.975908 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7355b-2918-4214-8a68-5d43e2457630 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:43.976190 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7355b-2918-4214-8a68-5d43e2457630 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:43.976467 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7355b-2918-4214-8a68-5d43e2457630 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:43.990958 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7355b-2918-4214-8a68-5d43e2457630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:04:43.996338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-2ac7355b-2918-4214-8a68-5d43e2457630 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:04:43.996338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:43.996338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:43.996338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:43.996338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:43.996338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:43.996338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:43.996338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:43.996338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:43.996338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:43.996338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:43.996338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:43.996338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:04:43.996338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:04:43.996338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:04:43.996338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:04:43.997334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:04:43.997334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:04:43.997334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:04:43.997334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:04:43.997334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:43.997334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:43.997334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:43.997334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:43.997334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:43.997334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:43.997334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:43.997334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:43.997334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:43.997334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:43.997334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:43.997334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:43.999366 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:43.999366 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:43.999366 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:43.999366 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:43.999366 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:04:43.999366 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:04:43.999366 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:04:43.999366 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:04:43.999366 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:04:43.999366 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:04:43.999366 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:04:43.999366 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:04:43.999366 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 54/102] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:04:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:04:44.007054 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbf079-45d7-41de-8d05-4dc7dc60bf29 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:44.134532 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbf079-45d7-41de-8d05-4dc7dc60bf29 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:44.169063 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40c382-149d-4253-bc3c-94eb983af2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:44.169716 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40c382-149d-4253-bc3c-94eb983af2c7 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:44.169997 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40c382-149d-4253-bc3c-94eb983af2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:44.170272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40c382-149d-4253-bc3c-94eb983af2c7 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:44.171008 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40c382-149d-4253-bc3c-94eb983af2c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:44.171318 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40c382-149d-4253-bc3c-94eb983af2c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:44.172707 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40c382-149d-4253-bc3c-94eb983af2c7 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:44.177462 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7355b-2918-4214-8a68-5d43e2457630 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:44.186933 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:44.193163 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 49/103] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:04:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:44.204540 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40c382-149d-4253-bc3c-94eb983af2c7 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:44.218165 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:44.350940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7355b-2918-4214-8a68-5d43e2457630 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:44.381085 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40c382-149d-4253-bc3c-94eb983af2c7 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:44.392190 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de0afc-d5c5-42b8-a5f2-d2076d9d3aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:44.393546 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de0afc-d5c5-42b8-a5f2-d2076d9d3aed None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:44.394046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de0afc-d5c5-42b8-a5f2-d2076d9d3aed None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:44.394498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de0afc-d5c5-42b8-a5f2-d2076d9d3aed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:44.406664 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de0afc-d5c5-42b8-a5f2-d2076d9d3aed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:04:44.412011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-11de0afc-d5c5-42b8-a5f2-d2076d9d3aed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:04:44.412011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:44.412011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:44.412011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:44.412011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:44.412011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:44.412011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:44.412011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:44.412011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:44.412011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:44.412011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:44.412011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:44.412011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:04:44.412011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:04:44.412011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:04:44.412011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:04:44.412866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:04:44.412866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:04:44.412866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:04:44.412866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:04:44.412866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:44.412866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:44.412866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:44.412866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:44.412866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:44.412866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:44.412866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:44.412866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:44.412866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:44.412866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:44.412866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:44.412866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:44.413627 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:44.413627 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:44.413627 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:44.413627 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:44.413627 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:04:44.413627 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:04:44.413627 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:04:44.413627 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:04:44.413627 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:04:44.413627 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:04:44.413627 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:04:44.413627 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:04:44.416594 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 55/104] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 15:04:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:04:44.418079 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235b419-4dad-48a5-9f94-3a6a3de1e265 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:44.418552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235b419-4dad-48a5-9f94-3a6a3de1e265 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:44.419473 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235b419-4dad-48a5-9f94-3a6a3de1e265 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:44.421867 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 56/105] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:44.426856 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235b419-4dad-48a5-9f94-3a6a3de1e265 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:44.452976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b4ac3-a7a6-4e9f-92e1-45e7b642081f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:44.455368 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b4ac3-a7a6-4e9f-92e1-45e7b642081f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:44.455843 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b4ac3-a7a6-4e9f-92e1-45e7b642081f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:44.456326 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b4ac3-a7a6-4e9f-92e1-45e7b642081f None admin] PATH_INFO: `/v3/users/5c369ed3953b40509e871e6e4235d645` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:44.481075 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b4ac3-a7a6-4e9f-92e1-45e7b642081f None admin] RBAC: Authorizing `identity:get_user(user_id=5c369ed3953b40509e871e6e4235d645)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:44.482942 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b4ac3-a7a6-4e9f-92e1-45e7b642081f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:44.484819 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 50/106] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:04:44 2022] GET /identity/v3/users/5c369ed3953b40509e871e6e4235d645 => generated 289 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:04:44.485824 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e693d-ace1-4614-8fbb-0e61ff8198bf None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:44.486111 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e693d-ace1-4614-8fbb-0e61ff8198bf None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:44.486390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e693d-ace1-4614-8fbb-0e61ff8198bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:44.514477 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:44.527341 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-3c1e693d-ace1-4614-8fbb-0e61ff8198bf None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:44.529055 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-3c1e693d-ace1-4614-8fbb-0e61ff8198bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:44.555789 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235b419-4dad-48a5-9f94-3a6a3de1e265 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:44.604124 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd666cc4-385b-4ed2-bf42-a3f6ce8d85ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:44.605078 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd666cc4-385b-4ed2-bf42-a3f6ce8d85ea None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:44.605541 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd666cc4-385b-4ed2-bf42-a3f6ce8d85ea None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:44.606996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd666cc4-385b-4ed2-bf42-a3f6ce8d85ea None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:44.607872 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd666cc4-385b-4ed2-bf42-a3f6ce8d85ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:44.610011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd666cc4-385b-4ed2-bf42-a3f6ce8d85ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:44.611660 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd666cc4-385b-4ed2-bf42-a3f6ce8d85ea None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:44.625039 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 57/107] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:04:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:44.626249 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd666cc4-385b-4ed2-bf42-a3f6ce8d85ea None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:44.635276 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:44.646932 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 51/108] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:44.648396 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b2105-1b5c-47dd-84c2-cb3507e0b0e2 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:44.648751 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b2105-1b5c-47dd-84c2-cb3507e0b0e2 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:44.649130 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b2105-1b5c-47dd-84c2-cb3507e0b0e2 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:44.650480 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 52/109] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:44.651272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b2105-1b5c-47dd-84c2-cb3507e0b0e2 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:44.754575 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd666cc4-385b-4ed2-bf42-a3f6ce8d85ea None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:44.774978 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b2105-1b5c-47dd-84c2-cb3507e0b0e2 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:44.789925 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:44.801062 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ac622-d06e-44f3-9c2d-82bdc50a7339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:44.802259 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ac622-d06e-44f3-9c2d-82bdc50a7339 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:44.803120 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ac622-d06e-44f3-9c2d-82bdc50a7339 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:44.803833 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ac622-d06e-44f3-9c2d-82bdc50a7339 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:44.818063 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714e323-47a8-41f9-ac30-4652d7096a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:44.818713 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714e323-47a8-41f9-ac30-4652d7096a71 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:44.819045 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714e323-47a8-41f9-ac30-4652d7096a71 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:44.819320 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714e323-47a8-41f9-ac30-4652d7096a71 None admin] PATH_INFO: `/v3/users/652ac5e448bf46d3bcf76749e06bdf9d` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:44.820546 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714e323-47a8-41f9-ac30-4652d7096a71 None admin] RBAC: Authorizing `identity:get_user(user_id=652ac5e448bf46d3bcf76749e06bdf9d)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:44.822358 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714e323-47a8-41f9-ac30-4652d7096a71 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:44.824197 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 53/110] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:04:44 2022] GET /identity/v3/users/652ac5e448bf46d3bcf76749e06bdf9d => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:44.825358 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6790eb-2d54-424a-a49e-bd23e6bf8cd8 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:44.825684 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6790eb-2d54-424a-a49e-bd23e6bf8cd8 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:44.825984 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6790eb-2d54-424a-a49e-bd23e6bf8cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:44.846136 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-6b6790eb-2d54-424a-a49e-bd23e6bf8cd8 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:44.847339 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-6b6790eb-2d54-424a-a49e-bd23e6bf8cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:44.880091 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ac622-d06e-44f3-9c2d-82bdc50a7339 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:44.881498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ac622-d06e-44f3-9c2d-82bdc50a7339 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:44.909884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:44.923040 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 54/111] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:44.924581 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c1ff0-77cc-4de5-9e5f-5efa0a2a1f4e None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:44.924926 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c1ff0-77cc-4de5-9e5f-5efa0a2a1f4e None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:44.925263 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c1ff0-77cc-4de5-9e5f-5efa0a2a1f4e None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:44.927060 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 55/112] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:44.927837 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c1ff0-77cc-4de5-9e5f-5efa0a2a1f4e None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:45.002454 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 58/113] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:04:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:04:45.003766 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480cbd2-2cb0-4a13-afd5-bf61f486ce68 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:45.004039 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480cbd2-2cb0-4a13-afd5-bf61f486ce68 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:45.004314 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480cbd2-2cb0-4a13-afd5-bf61f486ce68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:45.029398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-c480cbd2-2cb0-4a13-afd5-bf61f486ce68 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:45.030638 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-c480cbd2-2cb0-4a13-afd5-bf61f486ce68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:45.053940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:45.081486 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c1ff0-77cc-4de5-9e5f-5efa0a2a1f4e None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:45.098203 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 59/114] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:45.099131 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480cbd2-2cb0-4a13-afd5-bf61f486ce68 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:45.121024 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dac48-f819-4b7e-9ce3-6072dde1f883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:45.121818 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dac48-f819-4b7e-9ce3-6072dde1f883 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:45.122101 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dac48-f819-4b7e-9ce3-6072dde1f883 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:45.122374 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dac48-f819-4b7e-9ce3-6072dde1f883 None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:45.123676 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dac48-f819-4b7e-9ce3-6072dde1f883 None admin] RBAC: Authorizing `identity:get_project(project_id=f366603e9ef2405c82fc9fb4c82d1ba0)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:45.125148 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dac48-f819-4b7e-9ce3-6072dde1f883 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:45.127401 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 56/115] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:04:44 2022] GET /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:45.128547 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dac48-f819-4b7e-9ce3-6072dde1f883 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:45.194047 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:45.273606 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dac48-f819-4b7e-9ce3-6072dde1f883 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:45.282645 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480cbd2-2cb0-4a13-afd5-bf61f486ce68 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:45.318801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4f3de-a0a8-48c2-aeba-ed90930ab910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:45.319449 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4f3de-a0a8-48c2-aeba-ed90930ab910 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:45.319728 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4f3de-a0a8-48c2-aeba-ed90930ab910 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:45.319999 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4f3de-a0a8-48c2-aeba-ed90930ab910 None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:45.321203 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4f3de-a0a8-48c2-aeba-ed90930ab910 None admin] RBAC: Authorizing `identity:get_project(project_id=f366603e9ef2405c82fc9fb4c82d1ba0)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:45.321802 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb5159-f917-42a1-992b-48fb4e698265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:45.322445 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb5159-f917-42a1-992b-48fb4e698265 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:45.322678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4f3de-a0a8-48c2-aeba-ed90930ab910 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:45.322776 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb5159-f917-42a1-992b-48fb4e698265 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:45.323039 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb5159-f917-42a1-992b-48fb4e698265 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:45.324378 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 57/116] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:04:45 2022] GET /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:45.325121 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4f3de-a0a8-48c2-aeba-ed90930ab910 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:45.339456 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb5159-f917-42a1-992b-48fb4e698265 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:04:45.344469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-45cb5159-f917-42a1-992b-48fb4e698265 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:04:45.344469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:45.344469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:45.344469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:45.344469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:45.344469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:45.344469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:45.344469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:45.344469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:45.344469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:45.344469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:45.344469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:45.344469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:04:45.344469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:04:45.344469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:04:45.344469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:04:45.345401 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:04:45.345401 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:04:45.345401 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:04:45.345401 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:04:45.345401 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:45.345401 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:45.345401 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:45.345401 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:45.345401 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:45.345401 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:45.345401 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:45.345401 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:45.345401 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:45.345401 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:45.345401 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:45.345401 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:45.346203 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:45.346203 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:45.346203 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:45.346203 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:45.346203 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:04:45.346203 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:04:45.346203 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:04:45.346203 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:04:45.346203 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:04:45.346203 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:04:45.346203 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:04:45.346203 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:04:45.346203 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 60/117] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 15:04:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:04:45.346826 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb5159-f917-42a1-992b-48fb4e698265 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:45.367409 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:45.432048 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4f3de-a0a8-48c2-aeba-ed90930ab910 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:45.453025 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb5159-f917-42a1-992b-48fb4e698265 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:45.459532 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:45.468318 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42432b4e-139d-4cdc-ad18-bc41caa76840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:45.468976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42432b4e-139d-4cdc-ad18-bc41caa76840 None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:45.469259 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42432b4e-139d-4cdc-ad18-bc41caa76840 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:45.469531 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42432b4e-139d-4cdc-ad18-bc41caa76840 None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0/users/652ac5e448bf46d3bcf76749e06bdf9d/roles/07d4069c848d4ee9abb586256ee26f20` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:45.471458 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42432b4e-139d-4cdc-ad18-bc41caa76840 None admin] RBAC: Authorizing `identity:create_grant(project_id=f366603e9ef2405c82fc9fb4c82d1ba0, user_id=652ac5e448bf46d3bcf76749e06bdf9d, role_id=07d4069c848d4ee9abb586256ee26f20)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:45.472918 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42432b4e-139d-4cdc-ad18-bc41caa76840 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:45.486432 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 58/118] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 15:04:45 2022] PUT /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0/users/652ac5e448bf46d3bcf76749e06bdf9d/roles/07d4069c848d4ee9abb586256ee26f20 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:04:45.487238 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42432b4e-139d-4cdc-ad18-bc41caa76840 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:45.494046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d43b25-16f7-49e9-be1f-d0914e10a33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:45.494710 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d43b25-16f7-49e9-be1f-d0914e10a33c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:45.494982 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d43b25-16f7-49e9-be1f-d0914e10a33c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:45.495248 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d43b25-16f7-49e9-be1f-d0914e10a33c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:45.497146 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d43b25-16f7-49e9-be1f-d0914e10a33c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:45.499089 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d43b25-16f7-49e9-be1f-d0914e10a33c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:45.501114 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 61/119] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:04:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:45.502612 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a67e9-f912-4b1e-8ad8-f9cf78a4c988 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:45.502896 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a67e9-f912-4b1e-8ad8-f9cf78a4c988 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:45.503152 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a67e9-f912-4b1e-8ad8-f9cf78a4c988 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:45.504569 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 62/120] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:45.509515 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a67e9-f912-4b1e-8ad8-f9cf78a4c988 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:45.599562 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42432b4e-139d-4cdc-ad18-bc41caa76840 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:45.613467 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:45.632621 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a67e9-f912-4b1e-8ad8-f9cf78a4c988 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:45.638076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69090905-9ebe-48c4-81ae-357509e2f342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:45.638718 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69090905-9ebe-48c4-81ae-357509e2f342 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:45.638991 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69090905-9ebe-48c4-81ae-357509e2f342 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:45.639263 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69090905-9ebe-48c4-81ae-357509e2f342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:45.639999 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69090905-9ebe-48c4-81ae-357509e2f342 None admin] RBAC: Adding query filter params (role.id=c3cc9c287a1d45e9ad18d3ce7b9975cb, scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0, user.id=5c369ed3953b40509e871e6e4235d645) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:45.640304 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69090905-9ebe-48c4-81ae-357509e2f342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:45.642504 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69090905-9ebe-48c4-81ae-357509e2f342 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:45.657742 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 59/121] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:04:45 2022] GET /identity/v3/role_assignments?user.id=5c369ed3953b40509e871e6e4235d645&scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0&role.id=c3cc9c287a1d45e9ad18d3ce7b9975cb => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:45.657742 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69090905-9ebe-48c4-81ae-357509e2f342 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:45.680527 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba366008-6db3-4919-a7c6-fe588af04b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:45.681365 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba366008-6db3-4919-a7c6-fe588af04b24 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:45.681786 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba366008-6db3-4919-a7c6-fe588af04b24 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:45.682177 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba366008-6db3-4919-a7c6-fe588af04b24 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:45.682944 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba366008-6db3-4919-a7c6-fe588af04b24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:45.683383 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba366008-6db3-4919-a7c6-fe588af04b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:45.685093 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba366008-6db3-4919-a7c6-fe588af04b24 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:45.696134 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 63/122] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:04:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:45.697223 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba366008-6db3-4919-a7c6-fe588af04b24 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:45.736792 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:45.808914 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69090905-9ebe-48c4-81ae-357509e2f342 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:45.814021 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba366008-6db3-4919-a7c6-fe588af04b24 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:45.855006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c488e7-9620-4bb6-b98e-301ed0316b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:45.855632 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c488e7-9620-4bb6-b98e-301ed0316b1c None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:45.855914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c488e7-9620-4bb6-b98e-301ed0316b1c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:45.856189 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c488e7-9620-4bb6-b98e-301ed0316b1c None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:45.857163 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c488e7-9620-4bb6-b98e-301ed0316b1c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:45.858661 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c488e7-9620-4bb6-b98e-301ed0316b1c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:45.859783 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174caf0-64c4-4368-b6ac-4bf66ffa05f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:45.860563 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174caf0-64c4-4368-b6ac-4bf66ffa05f4 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:45.860995 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174caf0-64c4-4368-b6ac-4bf66ffa05f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:45.861366 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174caf0-64c4-4368-b6ac-4bf66ffa05f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:45.875232 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174caf0-64c4-4368-b6ac-4bf66ffa05f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:04:45.881749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-f174caf0-64c4-4368-b6ac-4bf66ffa05f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:04:45.881749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:45.881749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:45.881749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:45.881749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:45.881749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:45.881749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:45.881749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:45.881749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:45.881749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:45.881749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:45.881749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:45.881749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:04:45.881749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:04:45.881749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:04:45.881749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:04:45.882704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:04:45.882704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:04:45.882704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:04:45.882704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:04:45.882704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:45.882704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:45.882704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:45.882704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:45.882704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:45.882704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:45.882704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:45.882704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:45.882704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:45.882704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:45.882704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:45.882704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:45.883582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:45.883582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:45.883582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:45.883582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:45.883582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:04:45.883582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:04:45.883582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:04:45.883582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:04:45.883582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:04:45.883582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:04:45.883582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:04:45.883582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:04:45.883582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 60/123] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:04:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:04:45.887963 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:45.889449 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913f06f-71d7-4404-9118-8f66456be9a8 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:45.889639 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913f06f-71d7-4404-9118-8f66456be9a8 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:45.890043 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913f06f-71d7-4404-9118-8f66456be9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:45.896396 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 64/124] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 15:04:45 2022] POST /identity/v3/projects => generated 302 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:04:45.896396 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c488e7-9620-4bb6-b98e-301ed0316b1c None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:45.919467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-0913f06f-71d7-4404-9118-8f66456be9a8 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:45.920768 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-0913f06f-71d7-4404-9118-8f66456be9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:45.995285 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 61/125] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:46.000346 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913f06f-71d7-4404-9118-8f66456be9a8 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:46.082412 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:46.113895 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c488e7-9620-4bb6-b98e-301ed0316b1c None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:46.180290 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913f06f-71d7-4404-9118-8f66456be9a8 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:46.220407 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a6efd-7373-4cd2-a482-265226c728b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:46.221441 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a6efd-7373-4cd2-a482-265226c728b7 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:46.221552 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a6efd-7373-4cd2-a482-265226c728b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:46.221843 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a6efd-7373-4cd2-a482-265226c728b7 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:46.222543 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a6efd-7373-4cd2-a482-265226c728b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:46.222849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a6efd-7373-4cd2-a482-265226c728b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:46.224247 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a6efd-7373-4cd2-a482-265226c728b7 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:46.234302 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 62/126] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:04:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:46.241296 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a6efd-7373-4cd2-a482-265226c728b7 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:46.243916 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98951ae-4be9-4f2e-b643-8db0731f329d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:46.244571 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98951ae-4be9-4f2e-b643-8db0731f329d None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:46.244845 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98951ae-4be9-4f2e-b643-8db0731f329d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:46.245115 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98951ae-4be9-4f2e-b643-8db0731f329d None admin] PATH_INFO: `/v3/users/5b5fc9396faf4a98b542619453683e4f` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:46.248115 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98951ae-4be9-4f2e-b643-8db0731f329d None admin] RBAC: Authorizing `identity:get_user(user_id=5b5fc9396faf4a98b542619453683e4f)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:46.250220 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98951ae-4be9-4f2e-b643-8db0731f329d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:46.251823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 65/127] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:04:45 2022] GET /identity/v3/users/5b5fc9396faf4a98b542619453683e4f => generated 275 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:46.275386 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98951ae-4be9-4f2e-b643-8db0731f329d None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:46.350711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a6efd-7373-4cd2-a482-265226c728b7 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:46.360218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:46.393650 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5310388-f57f-4fce-b018-055ff7211bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:46.394498 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5310388-f57f-4fce-b018-055ff7211bbd None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:46.394789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5310388-f57f-4fce-b018-055ff7211bbd None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:46.395356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5310388-f57f-4fce-b018-055ff7211bbd None admin] PATH_INFO: `/v3/users/5b5fc9396faf4a98b542619453683e4f` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:46.396545 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5310388-f57f-4fce-b018-055ff7211bbd None admin] RBAC: Authorizing `identity:get_user(user_id=5b5fc9396faf4a98b542619453683e4f)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:46.398502 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5310388-f57f-4fce-b018-055ff7211bbd None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:46.400469 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 63/128] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:04:46 2022] GET /identity/v3/users/5b5fc9396faf4a98b542619453683e4f => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:46.406683 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5310388-f57f-4fce-b018-055ff7211bbd None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:46.457605 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98951ae-4be9-4f2e-b643-8db0731f329d None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:46.494104 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:46.504092 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9bafa-65f9-4989-a144-531feb6724d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:46.504092 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9bafa-65f9-4989-a144-531feb6724d1 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:46.504874 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9bafa-65f9-4989-a144-531feb6724d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:46.505154 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9bafa-65f9-4989-a144-531feb6724d1 None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:46.506801 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9bafa-65f9-4989-a144-531feb6724d1 None admin] RBAC: Authorizing `identity:get_project(project_id=f366603e9ef2405c82fc9fb4c82d1ba0)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:46.509000 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9bafa-65f9-4989-a144-531feb6724d1 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:46.511185 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 66/129] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:04:46 2022] GET /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:04:46.518579 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9bafa-65f9-4989-a144-531feb6724d1 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:46.531783 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5310388-f57f-4fce-b018-055ff7211bbd None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:46.569957 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da6b4a-0af8-499c-83e0-fcb658688610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:46.571054 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da6b4a-0af8-499c-83e0-fcb658688610 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:46.571606 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da6b4a-0af8-499c-83e0-fcb658688610 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:46.572047 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da6b4a-0af8-499c-83e0-fcb658688610 None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:46.573461 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da6b4a-0af8-499c-83e0-fcb658688610 None admin] RBAC: Authorizing `identity:get_project(project_id=f366603e9ef2405c82fc9fb4c82d1ba0)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:46.575174 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da6b4a-0af8-499c-83e0-fcb658688610 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:46.577483 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 64/130] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:04:46 2022] GET /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:04:46.583350 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da6b4a-0af8-499c-83e0-fcb658688610 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:46.670113 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:46.718724 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da6b4a-0af8-499c-83e0-fcb658688610 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:46.756666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07102c2f-c347-4669-9e7f-4fab9b7aef05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:46.757263 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07102c2f-c347-4669-9e7f-4fab9b7aef05 None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:46.757548 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07102c2f-c347-4669-9e7f-4fab9b7aef05 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:46.757877 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07102c2f-c347-4669-9e7f-4fab9b7aef05 None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0/users/5b5fc9396faf4a98b542619453683e4f/roles/dfd00108a3dd42f1a9dd0335f4b8f508` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:46.759909 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07102c2f-c347-4669-9e7f-4fab9b7aef05 None admin] RBAC: Authorizing `identity:create_grant(project_id=f366603e9ef2405c82fc9fb4c82d1ba0, user_id=5b5fc9396faf4a98b542619453683e4f, role_id=dfd00108a3dd42f1a9dd0335f4b8f508)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:46.762002 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07102c2f-c347-4669-9e7f-4fab9b7aef05 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:46.781392 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 65/131] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 15:04:46 2022] PUT /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0/users/5b5fc9396faf4a98b542619453683e4f/roles/dfd00108a3dd42f1a9dd0335f4b8f508 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:04:46.782375 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07102c2f-c347-4669-9e7f-4fab9b7aef05 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:46.804692 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9bafa-65f9-4989-a144-531feb6724d1 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:46.918691 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:46.924624 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07102c2f-c347-4669-9e7f-4fab9b7aef05 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:46.974461 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61314e4-5c97-42b3-8073-83d7a3ae16d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:46.975148 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61314e4-5c97-42b3-8073-83d7a3ae16d4 None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:46.975425 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61314e4-5c97-42b3-8073-83d7a3ae16d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:46.975695 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61314e4-5c97-42b3-8073-83d7a3ae16d4 None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0/users/5b5fc9396faf4a98b542619453683e4f/roles/877977a662dd49daab1ee42ba834153e` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:46.990590 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61314e4-5c97-42b3-8073-83d7a3ae16d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f366603e9ef2405c82fc9fb4c82d1ba0, user_id=5b5fc9396faf4a98b542619453683e4f, role_id=877977a662dd49daab1ee42ba834153e)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:46.992088 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61314e4-5c97-42b3-8073-83d7a3ae16d4 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:46.998511 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177138f0-abfd-45f9-a7bc-69125792949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:46.999425 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177138f0-abfd-45f9-a7bc-69125792949e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:46.999847 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177138f0-abfd-45f9-a7bc-69125792949e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:47.000264 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177138f0-abfd-45f9-a7bc-69125792949e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:47.001421 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:47.019136 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177138f0-abfd-45f9-a7bc-69125792949e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:04:47.030493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-177138f0-abfd-45f9-a7bc-69125792949e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:04:47.030493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:47.030493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:47.030493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:47.030493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:47.030493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:47.030493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:47.030493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:47.030493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:47.030493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:47.030493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:47.030493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:47.030493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:04:47.030493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:04:47.030493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:04:47.030493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:04:47.031669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:04:47.031669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:04:47.031669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:04:47.031669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:04:47.031669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:47.031669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:47.031669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:47.031669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:47.031669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:47.031669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:47.031669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:47.031669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:47.031669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:47.031669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:47.031669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:47.031669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:47.032703 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:47.032703 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:47.032703 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:47.032703 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:47.032703 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:04:47.032703 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:04:47.032703 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:04:47.032703 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:04:47.032703 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:04:47.032703 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:04:47.032703 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:04:47.032703 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:04:47.033471 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 67/132] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 15:04:46 2022] PUT /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0/users/5b5fc9396faf4a98b542619453683e4f/roles/877977a662dd49daab1ee42ba834153e => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:04:47.035289 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 66/133] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:04:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:04:47.041940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61314e4-5c97-42b3-8073-83d7a3ae16d4 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:47.199702 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61314e4-5c97-42b3-8073-83d7a3ae16d4 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:47.237635 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc568a3-f78e-41c9-875b-08ce48a8453b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:47.238302 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc568a3-f78e-41c9-875b-08ce48a8453b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:47.238577 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc568a3-f78e-41c9-875b-08ce48a8453b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:47.238844 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc568a3-f78e-41c9-875b-08ce48a8453b None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:47.239529 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc568a3-f78e-41c9-875b-08ce48a8453b None admin] RBAC: Adding query filter params (name=member) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:47.239826 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc568a3-f78e-41c9-875b-08ce48a8453b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:47.241247 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc568a3-f78e-41c9-875b-08ce48a8453b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:47.251110 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 68/134] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:04:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:47.257407 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177138f0-abfd-45f9-a7bc-69125792949e None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:47.397252 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177138f0-abfd-45f9-a7bc-69125792949e None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:47.459518 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9e789-cc80-4fdd-bfcb-a7b42ce90f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:47.460489 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9e789-cc80-4fdd-bfcb-a7b42ce90f4e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:47.460911 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9e789-cc80-4fdd-bfcb-a7b42ce90f4e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:47.461376 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9e789-cc80-4fdd-bfcb-a7b42ce90f4e None admin] PATH_INFO: `/v3/users/5b5fc9396faf4a98b542619453683e4f` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:47.466374 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9e789-cc80-4fdd-bfcb-a7b42ce90f4e None admin] RBAC: Authorizing `identity:get_user(user_id=5b5fc9396faf4a98b542619453683e4f)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:47.468035 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9e789-cc80-4fdd-bfcb-a7b42ce90f4e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:47.470104 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 67/135] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:04:47 2022] GET /identity/v3/users/5b5fc9396faf4a98b542619453683e4f => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:47.475858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc568a3-f78e-41c9-875b-08ce48a8453b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:47.549445 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:47.600729 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc568a3-f78e-41c9-875b-08ce48a8453b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:47.634993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9f876-0740-4732-a65e-dda7cd3fbec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:47.635903 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9f876-0740-4732-a65e-dda7cd3fbec3 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:47.636334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9f876-0740-4732-a65e-dda7cd3fbec3 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:47.636754 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9f876-0740-4732-a65e-dda7cd3fbec3 None admin] PATH_INFO: `/v3/projects/38e8da47d3244110b70ec8fb9cccb880` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:47.638104 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9f876-0740-4732-a65e-dda7cd3fbec3 None admin] RBAC: Authorizing `identity:get_project(project_id=38e8da47d3244110b70ec8fb9cccb880)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:47.639852 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9f876-0740-4732-a65e-dda7cd3fbec3 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:47.641637 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 69/136] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:04:47 2022] GET /identity/v3/projects/38e8da47d3244110b70ec8fb9cccb880 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:47.647571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9e789-cc80-4fdd-bfcb-a7b42ce90f4e None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:47.677601 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:47.769706 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9e789-cc80-4fdd-bfcb-a7b42ce90f4e None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:47.803996 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a6392-3ff2-4e6c-988c-8a73418df548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:47.804668 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a6392-3ff2-4e6c-988c-8a73418df548 None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:47.804952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a6392-3ff2-4e6c-988c-8a73418df548 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:47.805281 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a6392-3ff2-4e6c-988c-8a73418df548 None admin] PATH_INFO: `/v3/projects/38e8da47d3244110b70ec8fb9cccb880/users/5b5fc9396faf4a98b542619453683e4f/roles/dfd00108a3dd42f1a9dd0335f4b8f508` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:47.807861 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a6392-3ff2-4e6c-988c-8a73418df548 None admin] RBAC: Authorizing `identity:create_grant(project_id=38e8da47d3244110b70ec8fb9cccb880, user_id=5b5fc9396faf4a98b542619453683e4f, role_id=dfd00108a3dd42f1a9dd0335f4b8f508)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:47.809335 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a6392-3ff2-4e6c-988c-8a73418df548 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:47.834478 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 68/137] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 15:04:47 2022] PUT /identity/v3/projects/38e8da47d3244110b70ec8fb9cccb880/users/5b5fc9396faf4a98b542619453683e4f/roles/dfd00108a3dd42f1a9dd0335f4b8f508 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:04:48.582378 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dc73d-0d6e-474a-bcdf-963e23fa32a6 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:48.582894 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dc73d-0d6e-474a-bcdf-963e23fa32a6 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:48.582964 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dc73d-0d6e-474a-bcdf-963e23fa32a6 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:48.584415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 70/138] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:48.590071 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff90a9b-6cee-4f59-9c05-d04c058e98bf None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:48.590365 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff90a9b-6cee-4f59-9c05-d04c058e98bf None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:48.590652 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff90a9b-6cee-4f59-9c05-d04c058e98bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:48.614675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-aff90a9b-6cee-4f59-9c05-d04c058e98bf None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:48.615890 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-aff90a9b-6cee-4f59-9c05-d04c058e98bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:48.703502 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 69/139] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:49.270277 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3dabe-55c5-425f-8d39-3912ccfefe70 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:49.270669 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3dabe-55c5-425f-8d39-3912ccfefe70 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:49.270854 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3dabe-55c5-425f-8d39-3912ccfefe70 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:49.272440 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 71/140] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:49.291366 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0d51b-1862-42b1-b01b-ab362d3d6408 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:49.291657 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0d51b-1862-42b1-b01b-ab362d3d6408 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:49.291935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0d51b-1862-42b1-b01b-ab362d3d6408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:49.318744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-5bf0d51b-1862-42b1-b01b-ab362d3d6408 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:49.319970 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-5bf0d51b-1862-42b1-b01b-ab362d3d6408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:49.325281 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3dabe-55c5-425f-8d39-3912ccfefe70 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:49.342433 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:49.441718 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 70/141] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:49.461009 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3dabe-55c5-425f-8d39-3912ccfefe70 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:49.486055 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f403f0-d2b2-4194-be1d-950bae81f4c2 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:49.486397 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f403f0-d2b2-4194-be1d-950bae81f4c2 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:49.486607 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f403f0-d2b2-4194-be1d-950bae81f4c2 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:49.487960 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 71/142] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:04:49.489804 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:49.493022 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3b8b5-d3e6-47ba-98e7-fa0009315b6b None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:49.493303 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3b8b5-d3e6-47ba-98e7-fa0009315b6b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:49.493571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3b8b5-d3e6-47ba-98e7-fa0009315b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:49.502455 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00332f7c-e8ad-44a5-909c-5fdd6548cc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:49.503384 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00332f7c-e8ad-44a5-909c-5fdd6548cc01 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:49.503859 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00332f7c-e8ad-44a5-909c-5fdd6548cc01 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:49.504339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00332f7c-e8ad-44a5-909c-5fdd6548cc01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:49.511994 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-b2c3b8b5-d3e6-47ba-98e7-fa0009315b6b None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:49.513169 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-b2c3b8b5-d3e6-47ba-98e7-fa0009315b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:49.517961 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00332f7c-e8ad-44a5-909c-5fdd6548cc01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:04:49.525237 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-00332f7c-e8ad-44a5-909c-5fdd6548cc01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:04:49.525237 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:49.525237 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:49.525237 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:49.525237 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:49.525237 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:49.525237 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:49.525237 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:49.525237 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:49.525237 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:49.525237 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:49.525237 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:49.525237 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:04:49.525237 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:04:49.525237 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:04:49.525237 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:04:49.526133 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:04:49.526133 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:04:49.526133 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:04:49.526133 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:04:49.526133 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:49.526133 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:49.526133 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:49.526133 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:49.526133 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:49.526133 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:49.526133 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:49.526133 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:49.526133 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:49.526133 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:49.526133 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:49.526133 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:49.526940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:49.526940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:49.526940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:49.526940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:49.526940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:04:49.526940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:04:49.526940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:04:49.526940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:04:49.526940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:04:49.526940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:04:49.526940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:04:49.526940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:04:49.526940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 72/143] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 15:04:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:04:49.536983 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00332f7c-e8ad-44a5-909c-5fdd6548cc01 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:49.598280 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 72/144] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:04:49.682763 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00332f7c-e8ad-44a5-909c-5fdd6548cc01 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:49.729770 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde78d7-78ab-45fb-8cbb-f30907f04396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:49.730396 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde78d7-78ab-45fb-8cbb-f30907f04396 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:49.730676 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde78d7-78ab-45fb-8cbb-f30907f04396 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:49.731006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde78d7-78ab-45fb-8cbb-f30907f04396 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:49.731991 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde78d7-78ab-45fb-8cbb-f30907f04396 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:49.732293 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde78d7-78ab-45fb-8cbb-f30907f04396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:49.733673 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde78d7-78ab-45fb-8cbb-f30907f04396 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:49.742354 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 73/145] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:04:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:49.748357 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3b8b5-d3e6-47ba-98e7-fa0009315b6b None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:49.854692 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:49.879582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3b8b5-d3e6-47ba-98e7-fa0009315b6b None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:49.915406 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a478f-b560-4dd6-bae7-f3a0bea9bbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:49.916058 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a478f-b560-4dd6-bae7-f3a0bea9bbf3 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:49.916334 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a478f-b560-4dd6-bae7-f3a0bea9bbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:49.916610 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a478f-b560-4dd6-bae7-f3a0bea9bbf3 None admin] PATH_INFO: `/v3/users/652ac5e448bf46d3bcf76749e06bdf9d` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:49.917765 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a478f-b560-4dd6-bae7-f3a0bea9bbf3 None admin] RBAC: Authorizing `identity:get_user(user_id=652ac5e448bf46d3bcf76749e06bdf9d)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:49.919348 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a478f-b560-4dd6-bae7-f3a0bea9bbf3 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:49.921173 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 73/146] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:04:49 2022] GET /identity/v3/users/652ac5e448bf46d3bcf76749e06bdf9d => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:49.926714 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde78d7-78ab-45fb-8cbb-f30907f04396 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:49.936617 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a478f-b560-4dd6-bae7-f3a0bea9bbf3 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:49.985167 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:50.051707 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde78d7-78ab-45fb-8cbb-f30907f04396 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:50.092352 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9dd90-e60d-48ee-be28-64d38117a966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:50.092968 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9dd90-e60d-48ee-be28-64d38117a966 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:50.093244 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9dd90-e60d-48ee-be28-64d38117a966 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:50.093513 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9dd90-e60d-48ee-be28-64d38117a966 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:50.172472 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9dd90-e60d-48ee-be28-64d38117a966 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:50.174041 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9dd90-e60d-48ee-be28-64d38117a966 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:50.188468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a478f-b560-4dd6-bae7-f3a0bea9bbf3 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:50.230949 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:50.282929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc8a48-945d-491f-9de6-f8afa12ad878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:50.285120 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc8a48-945d-491f-9de6-f8afa12ad878 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:50.285120 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc8a48-945d-491f-9de6-f8afa12ad878 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:50.285120 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc8a48-945d-491f-9de6-f8afa12ad878 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:50.291141 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 74/147] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:04:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:04:50.291981 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9dd90-e60d-48ee-be28-64d38117a966 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:50.334315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc8a48-945d-491f-9de6-f8afa12ad878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:04:50.339314 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-c6cc8a48-945d-491f-9de6-f8afa12ad878 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:04:50.339314 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:50.339314 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:50.339314 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:50.339314 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:50.339314 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:50.339314 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:50.339314 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:50.339314 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:50.339314 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:50.339314 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:50.339314 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:50.339314 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:04:50.339314 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:04:50.339314 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:04:50.339314 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:04:50.341390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:04:50.341390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:04:50.341390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:04:50.341390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:04:50.341390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:50.341390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:50.341390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:50.341390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:50.341390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:50.341390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:50.341390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:50.341390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:50.341390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:50.341390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:50.341390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:50.341390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:50.343324 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:50.343324 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:50.343324 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:50.343324 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:50.343324 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:04:50.343324 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:04:50.343324 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:04:50.343324 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:04:50.343324 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:04:50.343324 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:04:50.343324 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:04:50.343324 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:04:50.343324 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 74/148] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:04:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:04:50.343324 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc8a48-945d-491f-9de6-f8afa12ad878 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:50.362913 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:50.410760 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9dd90-e60d-48ee-be28-64d38117a966 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:50.455284 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29975466-728e-40e8-93bf-e474c4018ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:50.455929 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29975466-728e-40e8-93bf-e474c4018ed8 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:50.456206 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29975466-728e-40e8-93bf-e474c4018ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:50.456528 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29975466-728e-40e8-93bf-e474c4018ed8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:50.457797 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29975466-728e-40e8-93bf-e474c4018ed8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:50.459304 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29975466-728e-40e8-93bf-e474c4018ed8 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:50.461289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 75/149] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:04:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:50.461852 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29975466-728e-40e8-93bf-e474c4018ed8 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:50.509713 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:50.559422 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc8a48-945d-491f-9de6-f8afa12ad878 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:50.601497 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ed3ce-86a8-4025-abf3-fff7bb573d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:50.602242 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ed3ce-86a8-4025-abf3-fff7bb573d78 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:50.602679 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ed3ce-86a8-4025-abf3-fff7bb573d78 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:50.602966 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ed3ce-86a8-4025-abf3-fff7bb573d78 None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:50.604411 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ed3ce-86a8-4025-abf3-fff7bb573d78 None admin] RBAC: Authorizing `identity:get_project(project_id=f366603e9ef2405c82fc9fb4c82d1ba0)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:50.605912 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ed3ce-86a8-4025-abf3-fff7bb573d78 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:50.608962 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 75/150] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:04:50 2022] GET /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:50.609672 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ed3ce-86a8-4025-abf3-fff7bb573d78 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:50.660517 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29975466-728e-40e8-93bf-e474c4018ed8 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:50.700805 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad946c3e-124d-4304-a2d7-7a7a6aae2423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:50.701704 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad946c3e-124d-4304-a2d7-7a7a6aae2423 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:50.701999 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad946c3e-124d-4304-a2d7-7a7a6aae2423 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:50.702273 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad946c3e-124d-4304-a2d7-7a7a6aae2423 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:50.702939 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad946c3e-124d-4304-a2d7-7a7a6aae2423 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:50.703241 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad946c3e-124d-4304-a2d7-7a7a6aae2423 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:50.704902 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad946c3e-124d-4304-a2d7-7a7a6aae2423 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:50.717247 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 76/151] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:04:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:50.720606 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06affacf-c3bd-4817-9691-7bd6cfaa69a2 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:50.720606 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06affacf-c3bd-4817-9691-7bd6cfaa69a2 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:50.720606 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06affacf-c3bd-4817-9691-7bd6cfaa69a2 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:50.721200 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:50.722826 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 77/152] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:50.723737 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06affacf-c3bd-4817-9691-7bd6cfaa69a2 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:50.759072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ed3ce-86a8-4025-abf3-fff7bb573d78 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:50.798144 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed748d6a-5bbf-4bbe-b4dd-6c06d11d5187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:50.799042 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed748d6a-5bbf-4bbe-b4dd-6c06d11d5187 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:50.799454 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed748d6a-5bbf-4bbe-b4dd-6c06d11d5187 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:50.799920 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed748d6a-5bbf-4bbe-b4dd-6c06d11d5187 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:50.800733 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed748d6a-5bbf-4bbe-b4dd-6c06d11d5187 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:50.802473 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed748d6a-5bbf-4bbe-b4dd-6c06d11d5187 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:50.833965 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:50.834238 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 76/153] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 15:04:50 2022] POST /identity/v3/users => generated 283 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:04:50.835391 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed748d6a-5bbf-4bbe-b4dd-6c06d11d5187 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:50.862475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06affacf-c3bd-4817-9691-7bd6cfaa69a2 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:50.907743 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c63ff-cf67-4f0d-ad43-8c2f1dd85982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:50.908369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c63ff-cf67-4f0d-ad43-8c2f1dd85982 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:50.908649 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c63ff-cf67-4f0d-ad43-8c2f1dd85982 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:50.908921 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c63ff-cf67-4f0d-ad43-8c2f1dd85982 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:50.911440 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c63ff-cf67-4f0d-ad43-8c2f1dd85982 None admin] RBAC: Adding query filter params (role.id=07d4069c848d4ee9abb586256ee26f20, scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0, user.id=652ac5e448bf46d3bcf76749e06bdf9d) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:50.911440 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c63ff-cf67-4f0d-ad43-8c2f1dd85982 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:50.911440 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c63ff-cf67-4f0d-ad43-8c2f1dd85982 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:50.920634 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 78/154] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:04:50 2022] GET /identity/v3/role_assignments?user.id=652ac5e448bf46d3bcf76749e06bdf9d&scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0&role.id=07d4069c848d4ee9abb586256ee26f20 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:50.926649 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c47e9-29aa-4b25-afa2-7d89b65bcc83 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:50.926943 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c47e9-29aa-4b25-afa2-7d89b65bcc83 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:50.927228 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c47e9-29aa-4b25-afa2-7d89b65bcc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:50.975037 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-e42c47e9-29aa-4b25-afa2-7d89b65bcc83 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:50.977652 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-e42c47e9-29aa-4b25-afa2-7d89b65bcc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:51.024207 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed748d6a-5bbf-4bbe-b4dd-6c06d11d5187 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:51.086158 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:51.096601 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9821b-5515-4222-88a7-bec9fcde31df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:51.098886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9821b-5515-4222-88a7-bec9fcde31df None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:51.099261 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9821b-5515-4222-88a7-bec9fcde31df None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:51.099609 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9821b-5515-4222-88a7-bec9fcde31df None admin] PATH_INFO: `/v3/users/5c369ed3953b40509e871e6e4235d645` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:51.101780 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9821b-5515-4222-88a7-bec9fcde31df None admin] RBAC: Authorizing `identity:get_user(user_id=5c369ed3953b40509e871e6e4235d645)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:51.104292 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9821b-5515-4222-88a7-bec9fcde31df None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:51.109175 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 77/155] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:04:50 2022] GET /identity/v3/users/5c369ed3953b40509e871e6e4235d645 => generated 289 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:51.111197 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c17aa-d93a-4566-bbe1-22071cc352f1 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:51.111715 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c17aa-d93a-4566-bbe1-22071cc352f1 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:51.114209 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c17aa-d93a-4566-bbe1-22071cc352f1 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:51.116690 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 78/156] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:51.118898 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c17aa-d93a-4566-bbe1-22071cc352f1 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:51.123430 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 79/157] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:51.125593 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b2f29-48c0-4e5f-9703-dd1c87c3a619 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:51.125897 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b2f29-48c0-4e5f-9703-dd1c87c3a619 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:51.126169 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b2f29-48c0-4e5f-9703-dd1c87c3a619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:51.165510 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-ca4b2f29-48c0-4e5f-9703-dd1c87c3a619 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:51.166823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-ca4b2f29-48c0-4e5f-9703-dd1c87c3a619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:51.265333 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c17aa-d93a-4566-bbe1-22071cc352f1 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:51.283228 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 80/158] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:51.284942 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d3a7c-af0e-4b61-a23f-c5fc5865af39 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:51.285415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d3a7c-af0e-4b61-a23f-c5fc5865af39 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:51.285986 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d3a7c-af0e-4b61-a23f-c5fc5865af39 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:51.287376 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 81/159] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:51.292860 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957d1b2-f080-4d57-b09f-90316299633b None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:51.293140 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957d1b2-f080-4d57-b09f-90316299633b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:51.293396 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957d1b2-f080-4d57-b09f-90316299633b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:51.299577 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:51.307109 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fc0ca-2070-4331-bb1f-0687b114b922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:51.307811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fc0ca-2070-4331-bb1f-0687b114b922 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:51.308595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fc0ca-2070-4331-bb1f-0687b114b922 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:51.308877 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fc0ca-2070-4331-bb1f-0687b114b922 None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:51.310071 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8fc0ca-2070-4331-bb1f-0687b114b922 None admin] RBAC: Authorizing `identity:get_project(project_id=f366603e9ef2405c82fc9fb4c82d1ba0)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:51.311837 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8fc0ca-2070-4331-bb1f-0687b114b922 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:51.313492 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 79/160] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:04:51 2022] GET /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:51.315226 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-9957d1b2-f080-4d57-b09f-90316299633b None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:51.316499 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-9957d1b2-f080-4d57-b09f-90316299633b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:51.319399 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fc0ca-2070-4331-bb1f-0687b114b922 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:51.392984 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 82/161] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:04:51.408263 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:51.440985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fc0ca-2070-4331-bb1f-0687b114b922 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:51.476551 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77868c-0208-442c-92ba-0f496b33b448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:51.477257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77868c-0208-442c-92ba-0f496b33b448 None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:51.477534 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77868c-0208-442c-92ba-0f496b33b448 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:51.477835 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77868c-0208-442c-92ba-0f496b33b448 None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0/users/5c369ed3953b40509e871e6e4235d645/roles/c3cc9c287a1d45e9ad18d3ce7b9975cb` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:51.479785 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77868c-0208-442c-92ba-0f496b33b448 None admin] RBAC: Authorizing `identity:create_grant(project_id=f366603e9ef2405c82fc9fb4c82d1ba0, user_id=5c369ed3953b40509e871e6e4235d645, role_id=c3cc9c287a1d45e9ad18d3ce7b9975cb)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:51.481233 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77868c-0208-442c-92ba-0f496b33b448 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:51.499206 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 80/162] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 15:04:51 2022] PUT /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0/users/5c369ed3953b40509e871e6e4235d645/roles/c3cc9c287a1d45e9ad18d3ce7b9975cb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:04:51.515024 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957d1b2-f080-4d57-b09f-90316299633b None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:51.628664 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957d1b2-f080-4d57-b09f-90316299633b None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:51.662448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:51.667464 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92007de7-1a11-40b2-b63b-bbf71ad1dc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:51.668108 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92007de7-1a11-40b2-b63b-bbf71ad1dc46 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:51.668384 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92007de7-1a11-40b2-b63b-bbf71ad1dc46 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:51.668648 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92007de7-1a11-40b2-b63b-bbf71ad1dc46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:51.681964 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92007de7-1a11-40b2-b63b-bbf71ad1dc46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:04:51.687220 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-92007de7-1a11-40b2-b63b-bbf71ad1dc46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:04:51.687220 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:51.687220 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:51.687220 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:51.687220 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:51.687220 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:51.687220 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:51.687220 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:51.687220 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:51.687220 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:51.687220 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:51.687220 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:51.687220 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:04:51.687220 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:04:51.687220 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:04:51.687220 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:04:51.688117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:04:51.688117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:04:51.688117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:04:51.688117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:04:51.688117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:51.688117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:51.688117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:51.688117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:51.688117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:51.688117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:51.688117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:51.688117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:51.688117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:51.688117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:51.688117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:51.688117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:51.688974 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:51.688974 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:51.688974 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:51.688974 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:51.688974 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:04:51.688974 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:04:51.688974 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:04:51.688974 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:04:51.688974 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:04:51.688974 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:04:51.688974 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:04:51.688974 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:04:51.693385 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 83/163] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:04:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:04:51.694409 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77868c-0208-442c-92ba-0f496b33b448 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:51.697846 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92007de7-1a11-40b2-b63b-bbf71ad1dc46 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:51.846850 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77868c-0208-442c-92ba-0f496b33b448 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:51.863815 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92007de7-1a11-40b2-b63b-bbf71ad1dc46 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:51.875617 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:51.885297 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7ed99-ac72-4da0-a808-9974922386e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:51.885946 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7ed99-ac72-4da0-a808-9974922386e4 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:51.886224 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7ed99-ac72-4da0-a808-9974922386e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:51.886495 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7ed99-ac72-4da0-a808-9974922386e4 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:51.887275 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7ed99-ac72-4da0-a808-9974922386e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:51.887586 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7ed99-ac72-4da0-a808-9974922386e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:51.889429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7ed99-ac72-4da0-a808-9974922386e4 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:51.900406 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 81/164] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:04:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:51.901358 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7ed99-ac72-4da0-a808-9974922386e4 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:51.914289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9a7d5-012d-4efd-915c-bf743024ab6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:51.915135 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9a7d5-012d-4efd-915c-bf743024ab6c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:51.915418 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9a7d5-012d-4efd-915c-bf743024ab6c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:51.915691 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9a7d5-012d-4efd-915c-bf743024ab6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:51.927867 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9a7d5-012d-4efd-915c-bf743024ab6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:04:51.933149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-8cc9a7d5-012d-4efd-915c-bf743024ab6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:04:51.933149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:51.933149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:51.933149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:51.933149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:51.933149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:51.933149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:51.933149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:51.933149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:51.933149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:51.933149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:51.933149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:51.933149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:04:51.933149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:04:51.933149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:04:51.933149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:04:51.934090 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:04:51.934090 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:04:51.934090 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:04:51.934090 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:04:51.934090 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:51.934090 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:51.934090 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:51.934090 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:51.934090 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:51.934090 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:51.934090 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:51.934090 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:51.934090 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:51.934090 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:51.934090 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:51.934090 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:51.936530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:51.936530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:51.936530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:51.936530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:51.936530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:04:51.936530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:04:51.936530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:04:51.936530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:04:51.936530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:04:51.936530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:04:51.936530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:04:51.936530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:04:51.936530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 84/165] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 15:04:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:04:51.936530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9a7d5-012d-4efd-915c-bf743024ab6c None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:52.002264 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:52.029672 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7ed99-ac72-4da0-a808-9974922386e4 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:52.067214 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9a7d5-012d-4efd-915c-bf743024ab6c None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:52.075439 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da57e9-ca6a-4260-b357-6184cdc41773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:52.076103 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da57e9-ca6a-4260-b357-6184cdc41773 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:52.076390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da57e9-ca6a-4260-b357-6184cdc41773 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:52.076663 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da57e9-ca6a-4260-b357-6184cdc41773 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:52.103193 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da57e9-ca6a-4260-b357-6184cdc41773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:04:52.107249 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c2fde-8042-4c31-850b-40777f5eb8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:52.107888 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c2fde-8042-4c31-850b-40777f5eb8c2 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:52.108166 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c2fde-8042-4c31-850b-40777f5eb8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:52.108472 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c2fde-8042-4c31-850b-40777f5eb8c2 None admin] PATH_INFO: `/v3/users/5b5fc9396faf4a98b542619453683e4f` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:52.110315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-c4da57e9-ca6a-4260-b357-6184cdc41773 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:04:52.110315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:52.110315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:52.110315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:52.110315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:52.110315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:52.110315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:52.110315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:52.110315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:52.110315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:52.110315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:52.110315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:52.110315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:04:52.110315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:04:52.110315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:04:52.110315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:04:52.111178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:04:52.111178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:04:52.111178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:04:52.111178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:04:52.111178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:52.111178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:52.111178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:52.111178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:52.111178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:52.111178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:52.111178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:52.111178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:52.111178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:52.111178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:52.111178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:52.111178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:52.111978 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:52.111978 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:52.111978 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:52.111978 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:52.111978 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:04:52.111978 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:04:52.111978 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:04:52.111978 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:04:52.111978 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:04:52.111978 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:04:52.111978 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:04:52.111978 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:04:52.112672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c2fde-8042-4c31-850b-40777f5eb8c2 None admin] RBAC: Authorizing `identity:get_user(user_id=5b5fc9396faf4a98b542619453683e4f)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:52.112672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c2fde-8042-4c31-850b-40777f5eb8c2 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:52.113929 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 85/166] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:04:51 2022] GET /identity/v3/users/5b5fc9396faf4a98b542619453683e4f => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:52.114704 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c2fde-8042-4c31-850b-40777f5eb8c2 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:52.114991 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 82/167] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:04:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:04:52.124405 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da57e9-ca6a-4260-b357-6184cdc41773 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:52.187650 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:52.243701 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c2fde-8042-4c31-850b-40777f5eb8c2 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:52.243916 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da57e9-ca6a-4260-b357-6184cdc41773 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:52.282447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:52.286870 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9417cf-7168-4f4e-8a79-9cab78934c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:52.288136 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9417cf-7168-4f4e-8a79-9cab78934c28 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:52.288416 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9417cf-7168-4f4e-8a79-9cab78934c28 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:52.288683 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9417cf-7168-4f4e-8a79-9cab78934c28 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:52.290400 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9417cf-7168-4f4e-8a79-9cab78934c28 None admin] RBAC: Adding query filter params (name=member) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:52.290702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9417cf-7168-4f4e-8a79-9cab78934c28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:52.292113 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9417cf-7168-4f4e-8a79-9cab78934c28 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:52.308894 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 83/168] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:04:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:52.312125 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9417cf-7168-4f4e-8a79-9cab78934c28 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:52.313070 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1bccf-50a5-4fd5-8a1b-a3e8b8ed98c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:52.313878 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1bccf-50a5-4fd5-8a1b-a3e8b8ed98c3 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:52.314156 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1bccf-50a5-4fd5-8a1b-a3e8b8ed98c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:52.314420 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1bccf-50a5-4fd5-8a1b-a3e8b8ed98c3 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:52.315082 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1bccf-50a5-4fd5-8a1b-a3e8b8ed98c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:52.315377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1bccf-50a5-4fd5-8a1b-a3e8b8ed98c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:52.319265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1bccf-50a5-4fd5-8a1b-a3e8b8ed98c3 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:52.338530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 86/169] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:04:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:52.339399 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1bccf-50a5-4fd5-8a1b-a3e8b8ed98c3 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:52.508140 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9417cf-7168-4f4e-8a79-9cab78934c28 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:52.528388 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:52.540854 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1bccf-50a5-4fd5-8a1b-a3e8b8ed98c3 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:52.575263 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193ba47-c3ac-4d59-8864-20b30a191406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:52.575908 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193ba47-c3ac-4d59-8864-20b30a191406 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:52.576184 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193ba47-c3ac-4d59-8864-20b30a191406 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:52.576453 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193ba47-c3ac-4d59-8864-20b30a191406 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:52.611829 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e936de4-2ec7-4c9b-9b6d-9b9296cafed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:52.612530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e936de4-2ec7-4c9b-9b6d-9b9296cafed0 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:52.612807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e936de4-2ec7-4c9b-9b6d-9b9296cafed0 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:52.613075 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e936de4-2ec7-4c9b-9b6d-9b9296cafed0 None admin] PATH_INFO: `/v3/users/5b5fc9396faf4a98b542619453683e4f` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:52.615388 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e936de4-2ec7-4c9b-9b6d-9b9296cafed0 None admin] RBAC: Authorizing `identity:get_user(user_id=5b5fc9396faf4a98b542619453683e4f)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:52.616845 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e936de4-2ec7-4c9b-9b6d-9b9296cafed0 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:52.623237 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 87/170] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:04:52 2022] GET /identity/v3/users/5b5fc9396faf4a98b542619453683e4f => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:52.624052 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e936de4-2ec7-4c9b-9b6d-9b9296cafed0 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:52.710124 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193ba47-c3ac-4d59-8864-20b30a191406 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:52.712616 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193ba47-c3ac-4d59-8864-20b30a191406 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:52.735888 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:52.835335 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e936de4-2ec7-4c9b-9b6d-9b9296cafed0 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:52.894341 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 84/171] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:04:52.895025 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193ba47-c3ac-4d59-8864-20b30a191406 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:52.919219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:52.934428 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fb1a2-968b-453d-9f03-736a404f7b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:52.935084 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fb1a2-968b-453d-9f03-736a404f7b0a None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:52.935368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fb1a2-968b-453d-9f03-736a404f7b0a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:52.935644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fb1a2-968b-453d-9f03-736a404f7b0a None admin] PATH_INFO: `/v3/users/5b5fc9396faf4a98b542619453683e4f` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:52.942393 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fb1a2-968b-453d-9f03-736a404f7b0a None admin] RBAC: Authorizing `identity:get_user(user_id=5b5fc9396faf4a98b542619453683e4f)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:52.943871 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fb1a2-968b-453d-9f03-736a404f7b0a None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:52.945881 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 88/172] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:04:52 2022] GET /identity/v3/users/5b5fc9396faf4a98b542619453683e4f => generated 275 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:52.946660 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fb1a2-968b-453d-9f03-736a404f7b0a None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:53.050657 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193ba47-c3ac-4d59-8864-20b30a191406 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:53.098646 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a08fb-e988-4f69-9d98-824a9edb4d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:53.099759 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a08fb-e988-4f69-9d98-824a9edb4d0b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:53.100036 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a08fb-e988-4f69-9d98-824a9edb4d0b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:53.100304 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a08fb-e988-4f69-9d98-824a9edb4d0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:53.176433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fb1a2-968b-453d-9f03-736a404f7b0a None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:53.207784 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:53.228585 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a08fb-e988-4f69-9d98-824a9edb4d0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:53.230270 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a08fb-e988-4f69-9d98-824a9edb4d0b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:53.241297 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a42ab-8c36-42cf-9589-e185621d3f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:53.242226 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:53.243583 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a42ab-8c36-42cf-9589-e185621d3f04 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:53.244217 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a42ab-8c36-42cf-9589-e185621d3f04 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:53.244678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a42ab-8c36-42cf-9589-e185621d3f04 None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:53.247606 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a42ab-8c36-42cf-9589-e185621d3f04 None admin] RBAC: Authorizing `identity:get_project(project_id=f366603e9ef2405c82fc9fb4c82d1ba0)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:53.250332 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a42ab-8c36-42cf-9589-e185621d3f04 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:53.252207 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 89/173] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:04:52 2022] GET /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:53.253215 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a42ab-8c36-42cf-9589-e185621d3f04 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:53.371884 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a42ab-8c36-42cf-9589-e185621d3f04 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:53.410932 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6edca-d1d3-4ad5-b42d-1435087da2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:53.411866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6edca-d1d3-4ad5-b42d-1435087da2cc None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:53.412369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6edca-d1d3-4ad5-b42d-1435087da2cc None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:53.412828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6edca-d1d3-4ad5-b42d-1435087da2cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:53.436626 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 85/174] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:04:53.437307 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a08fb-e988-4f69-9d98-824a9edb4d0b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:53.476572 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:53.494870 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6edca-d1d3-4ad5-b42d-1435087da2cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:53.496733 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6edca-d1d3-4ad5-b42d-1435087da2cc None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:53.613072 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 90/175] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:04:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:04:53.614323 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6edca-d1d3-4ad5-b42d-1435087da2cc None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:53.679729 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a08fb-e988-4f69-9d98-824a9edb4d0b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:53.700392 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:53.719324 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:53.740075 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6edca-d1d3-4ad5-b42d-1435087da2cc None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:53.774498 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c301296-fbd6-4489-b1da-773dafb09d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:53.775189 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c301296-fbd6-4489-b1da-773dafb09d01 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:53.775474 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c301296-fbd6-4489-b1da-773dafb09d01 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:53.775747 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c301296-fbd6-4489-b1da-773dafb09d01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:53.776487 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c301296-fbd6-4489-b1da-773dafb09d01 None admin] RBAC: Adding query filter params (role.id=dfd00108a3dd42f1a9dd0335f4b8f508, scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0, user.id=5b5fc9396faf4a98b542619453683e4f) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:53.776793 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c301296-fbd6-4489-b1da-773dafb09d01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:53.778293 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c301296-fbd6-4489-b1da-773dafb09d01 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:53.784704 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98d008-391e-4671-9e91-9b037ab0c50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:53.785735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98d008-391e-4671-9e91-9b037ab0c50d None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:53.786278 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98d008-391e-4671-9e91-9b037ab0c50d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:53.787120 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98d008-391e-4671-9e91-9b037ab0c50d None admin] PATH_INFO: `/v3/projects/38e8da47d3244110b70ec8fb9cccb880` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:53.791456 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 86/176] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:04:53 2022] GET /identity/v3/role_assignments?user.id=5b5fc9396faf4a98b542619453683e4f&scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0&role.id=dfd00108a3dd42f1a9dd0335f4b8f508 => generated 608 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:53.791456 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c301296-fbd6-4489-b1da-773dafb09d01 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:53.792885 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98d008-391e-4671-9e91-9b037ab0c50d None admin] RBAC: Authorizing `identity:get_project(project_id=38e8da47d3244110b70ec8fb9cccb880)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:53.798652 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98d008-391e-4671-9e91-9b037ab0c50d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:53.802498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 91/177] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:04:53 2022] GET /identity/v3/projects/38e8da47d3244110b70ec8fb9cccb880 => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:53.808199 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98d008-391e-4671-9e91-9b037ab0c50d None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:54.043802 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98d008-391e-4671-9e91-9b037ab0c50d None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:54.058117 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c301296-fbd6-4489-b1da-773dafb09d01 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:54.127339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e5ada-ca93-4543-956c-16516d82ded4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:54.127953 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e5ada-ca93-4543-956c-16516d82ded4 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:54.128231 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e5ada-ca93-4543-956c-16516d82ded4 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:54.128498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e5ada-ca93-4543-956c-16516d82ded4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:54.129232 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e5ada-ca93-4543-956c-16516d82ded4 None admin] RBAC: Adding query filter params (role.id=dfd00108a3dd42f1a9dd0335f4b8f508, scope.project.id=38e8da47d3244110b70ec8fb9cccb880, user.id=5b5fc9396faf4a98b542619453683e4f) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:54.129534 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e5ada-ca93-4543-956c-16516d82ded4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:54.131012 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e5ada-ca93-4543-956c-16516d82ded4 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:54.141164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d76609-d657-48ce-95d1-224664d21b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:54.141845 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d76609-d657-48ce-95d1-224664d21b29 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:54.142130 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d76609-d657-48ce-95d1-224664d21b29 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:54.142410 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d76609-d657-48ce-95d1-224664d21b29 None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:54.143557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d76609-d657-48ce-95d1-224664d21b29 None admin] RBAC: Authorizing `identity:get_project(project_id=f366603e9ef2405c82fc9fb4c82d1ba0)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:54.144793 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 92/178] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:04:53 2022] GET /identity/v3/role_assignments?user.id=5b5fc9396faf4a98b542619453683e4f&scope.project.id=38e8da47d3244110b70ec8fb9cccb880&role.id=dfd00108a3dd42f1a9dd0335f4b8f508 => generated 608 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:54.145079 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d76609-d657-48ce-95d1-224664d21b29 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:54.147009 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 87/179] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:04:53 2022] GET /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0 => generated 298 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:54.153052 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e5ada-ca93-4543-956c-16516d82ded4 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:54.192925 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:54.292063 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e5ada-ca93-4543-956c-16516d82ded4 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:54.329402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34904a7-5e97-4589-91c2-e9c8e2072364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:54.330402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34904a7-5e97-4589-91c2-e9c8e2072364 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:54.330898 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34904a7-5e97-4589-91c2-e9c8e2072364 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:54.331360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34904a7-5e97-4589-91c2-e9c8e2072364 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:54.332284 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34904a7-5e97-4589-91c2-e9c8e2072364 None admin] RBAC: Adding query filter params (role.id=877977a662dd49daab1ee42ba834153e, scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0, user.id=5b5fc9396faf4a98b542619453683e4f) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:54.332785 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34904a7-5e97-4589-91c2-e9c8e2072364 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:54.334468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34904a7-5e97-4589-91c2-e9c8e2072364 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:54.341109 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 93/180] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:04:54 2022] GET /identity/v3/role_assignments?user.id=5b5fc9396faf4a98b542619453683e4f&scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0&role.id=877977a662dd49daab1ee42ba834153e => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:54.501215 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2882f7-464e-4121-a428-4dd025d4de1c None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:54.501618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2882f7-464e-4121-a428-4dd025d4de1c None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:54.501810 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2882f7-464e-4121-a428-4dd025d4de1c None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:54.503444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 88/181] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:54.509390 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f162e7-3b28-4423-b5a9-310c3d12f681 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:54.510047 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f162e7-3b28-4423-b5a9-310c3d12f681 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:54.510540 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f162e7-3b28-4423-b5a9-310c3d12f681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:54.537836 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-82f162e7-3b28-4423-b5a9-310c3d12f681 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:54.539581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-82f162e7-3b28-4423-b5a9-310c3d12f681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:54.624046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 94/182] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:54.936242 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c797c67-d218-4a61-82b9-a693ab8f8b09 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:54.936584 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c797c67-d218-4a61-82b9-a693ab8f8b09 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:54.936757 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c797c67-d218-4a61-82b9-a693ab8f8b09 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:54.938223 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 89/183] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:54.943618 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cb455-f5b1-4855-a9b4-53922bf16c9b None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:54.944147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cb455-f5b1-4855-a9b4-53922bf16c9b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:54.944666 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cb455-f5b1-4855-a9b4-53922bf16c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:54.966639 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-644cb455-f5b1-4855-a9b4-53922bf16c9b None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:54.968226 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-644cb455-f5b1-4855-a9b4-53922bf16c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:54.975660 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c797c67-d218-4a61-82b9-a693ab8f8b09 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:54.978329 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:55.048891 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:55.061611 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 95/184] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:55.120149 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c797c67-d218-4a61-82b9-a693ab8f8b09 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:55.156673 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5c107-7a35-4899-a3b1-d1302074034d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:55.157308 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5c107-7a35-4899-a3b1-d1302074034d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:55.157578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5c107-7a35-4899-a3b1-d1302074034d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:55.157876 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5c107-7a35-4899-a3b1-d1302074034d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:55.169714 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5c107-7a35-4899-a3b1-d1302074034d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:04:55.174643 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-73c5c107-7a35-4899-a3b1-d1302074034d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:04:55.174643 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:55.174643 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:55.174643 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:55.174643 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:55.174643 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:55.174643 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:55.174643 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:55.174643 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:55.174643 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:55.174643 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:55.174643 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:55.174643 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:04:55.174643 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:04:55.174643 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:04:55.174643 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:04:55.175596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:04:55.175596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:04:55.175596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:04:55.175596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:04:55.175596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:55.175596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:55.175596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:55.175596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:55.175596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:55.175596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:55.175596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:55.175596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:55.175596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:55.175596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:55.175596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:55.175596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:55.176387 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:55.176387 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:55.176387 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:55.176387 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:55.176387 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:04:55.176387 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:04:55.176387 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:04:55.176387 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:04:55.176387 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:04:55.176387 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:04:55.176387 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:04:55.176387 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:04:55.176387 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 90/185] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 15:04:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:04:55.182110 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cb455-f5b1-4855-a9b4-53922bf16c9b None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:55.283782 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cb455-f5b1-4855-a9b4-53922bf16c9b None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:55.317679 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366888a-10f1-4300-8107-33506e6ae447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:55.318317 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366888a-10f1-4300-8107-33506e6ae447 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:55.318596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366888a-10f1-4300-8107-33506e6ae447 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:55.318871 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366888a-10f1-4300-8107-33506e6ae447 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:55.319534 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366888a-10f1-4300-8107-33506e6ae447 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:55.319832 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366888a-10f1-4300-8107-33506e6ae447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:55.321368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366888a-10f1-4300-8107-33506e6ae447 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:55.330027 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 96/186] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:04:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:55.339116 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5c107-7a35-4899-a3b1-d1302074034d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:55.423030 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdf573-77f3-473e-9287-28db5a20935b None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:55.423364 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdf573-77f3-473e-9287-28db5a20935b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:55.423577 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdf573-77f3-473e-9287-28db5a20935b None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:55.424949 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 97/187] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:04:55.430102 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d5e2c-beff-4d43-9eb9-ab3c1f7ee89a None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:55.430536 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d5e2c-beff-4d43-9eb9-ab3c1f7ee89a None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:55.430761 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d5e2c-beff-4d43-9eb9-ab3c1f7ee89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:55.440873 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:55.449297 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5c107-7a35-4899-a3b1-d1302074034d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:55.451193 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:55.459212 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-679d5e2c-beff-4d43-9eb9-ab3c1f7ee89a None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:55.460904 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-679d5e2c-beff-4d43-9eb9-ab3c1f7ee89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:55.490159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4781e70-496e-4b6b-a764-9c2eb14e5ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:55.490811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4781e70-496e-4b6b-a764-9c2eb14e5ea3 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:55.491088 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4781e70-496e-4b6b-a764-9c2eb14e5ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:55.491358 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4781e70-496e-4b6b-a764-9c2eb14e5ea3 None admin] PATH_INFO: `/v3/users/47f211be357548cd82d0a1ef361d8c16` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:55.506640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4781e70-496e-4b6b-a764-9c2eb14e5ea3 None admin] RBAC: Authorizing `identity:get_user(user_id=47f211be357548cd82d0a1ef361d8c16)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:55.508135 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4781e70-496e-4b6b-a764-9c2eb14e5ea3 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:55.514468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 91/188] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:04:55 2022] GET /identity/v3/users/47f211be357548cd82d0a1ef361d8c16 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:55.514468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4781e70-496e-4b6b-a764-9c2eb14e5ea3 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:55.557849 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 98/189] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:55.557849 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d5e2c-beff-4d43-9eb9-ab3c1f7ee89a None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:55.620743 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4781e70-496e-4b6b-a764-9c2eb14e5ea3 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:55.661873 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002e8e5-5165-4b3b-a4cd-dba8006f426f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:55.663326 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002e8e5-5165-4b3b-a4cd-dba8006f426f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:55.663749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002e8e5-5165-4b3b-a4cd-dba8006f426f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:55.664161 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002e8e5-5165-4b3b-a4cd-dba8006f426f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:55.668417 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d5e2c-beff-4d43-9eb9-ab3c1f7ee89a None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:55.676687 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002e8e5-5165-4b3b-a4cd-dba8006f426f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:04:55.683501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-0002e8e5-5165-4b3b-a4cd-dba8006f426f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:04:55.683501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:55.683501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:55.683501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:55.683501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:55.683501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:55.683501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:55.683501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:55.683501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:55.683501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:55.683501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:55.683501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:55.683501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:04:55.683501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:04:55.683501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:04:55.683501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:04:55.684601 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:04:55.684601 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:04:55.684601 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:04:55.684601 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:04:55.684601 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:55.684601 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:55.684601 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:55.684601 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:55.684601 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:55.684601 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:55.684601 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:55.684601 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:55.684601 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:55.684601 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:55.684601 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:55.684601 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:55.685622 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:55.685622 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:55.685622 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:55.685622 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:55.685622 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:04:55.685622 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:04:55.685622 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:04:55.685622 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:04:55.685622 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:04:55.685622 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:04:55.685622 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:04:55.685622 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:04:55.694409 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 92/190] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:04:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:04:55.696706 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002e8e5-5165-4b3b-a4cd-dba8006f426f None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:55.725631 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d33a0-4e4b-40db-8c48-7bd5533a7c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:55.726158 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d33a0-4e4b-40db-8c48-7bd5533a7c86 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:55.726428 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d33a0-4e4b-40db-8c48-7bd5533a7c86 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:55.726750 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d33a0-4e4b-40db-8c48-7bd5533a7c86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:55.729749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:55.733453 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:55.810372 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d33a0-4e4b-40db-8c48-7bd5533a7c86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:55.812253 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d33a0-4e4b-40db-8c48-7bd5533a7c86 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:55.833998 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002e8e5-5165-4b3b-a4cd-dba8006f426f None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:55.869414 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1b580-d697-4848-805f-9275cc2c61df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:55.870215 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1b580-d697-4848-805f-9275cc2c61df None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:55.870492 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1b580-d697-4848-805f-9275cc2c61df None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:55.870761 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1b580-d697-4848-805f-9275cc2c61df None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:55.871422 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1b580-d697-4848-805f-9275cc2c61df None admin] RBAC: Adding query filter params (name=reader) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:55.871717 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1b580-d697-4848-805f-9275cc2c61df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:55.873109 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1b580-d697-4848-805f-9275cc2c61df None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:55.881729 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 93/191] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:04:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:55.882510 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1b580-d697-4848-805f-9275cc2c61df None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:55.921302 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 99/192] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:04:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:04:55.922164 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d33a0-4e4b-40db-8c48-7bd5533a7c86 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:55.955539 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:55.970254 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:55.989561 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1b580-d697-4848-805f-9275cc2c61df None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:56.022939 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d33a0-4e4b-40db-8c48-7bd5533a7c86 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:56.023428 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62db57-4d24-4e96-8b2c-4e565e8e25f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:56.024182 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62db57-4d24-4e96-8b2c-4e565e8e25f5 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:56.024435 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62db57-4d24-4e96-8b2c-4e565e8e25f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:56.024707 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62db57-4d24-4e96-8b2c-4e565e8e25f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:56.035554 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62db57-4d24-4e96-8b2c-4e565e8e25f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:04:56.040885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-db62db57-4d24-4e96-8b2c-4e565e8e25f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:04:56.040885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:56.040885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:56.040885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:56.040885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:56.040885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:56.040885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:56.040885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:56.040885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:56.040885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:56.040885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:56.040885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:56.040885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:04:56.040885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:04:56.040885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:04:56.040885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:04:56.041811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:04:56.041811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:04:56.041811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:04:56.041811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:04:56.041811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:56.041811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:56.041811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:56.041811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:56.041811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:56.041811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:56.041811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:56.041811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:56.041811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:56.041811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:56.041811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:56.041811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:56.042628 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:56.042628 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:56.042628 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:56.042628 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:56.042628 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:04:56.042628 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:04:56.042628 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:04:56.042628 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:04:56.042628 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:04:56.042628 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:04:56.042628 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:04:56.042628 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:04:56.042628 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 94/193] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 15:04:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:04:56.043275 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14730dfa-6451-4740-9bb1-141177e8d128 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:56.043403 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14730dfa-6451-4740-9bb1-141177e8d128 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:56.043769 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14730dfa-6451-4740-9bb1-141177e8d128 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:56.044893 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 95/194] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:56.045574 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14730dfa-6451-4740-9bb1-141177e8d128 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:56.062124 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dd20d-28d3-4843-ac54-9a8f62aaca76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:56.062698 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dd20d-28d3-4843-ac54-9a8f62aaca76 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:56.062963 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dd20d-28d3-4843-ac54-9a8f62aaca76 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:56.063229 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dd20d-28d3-4843-ac54-9a8f62aaca76 None admin] PATH_INFO: `/v3/users/5c369ed3953b40509e871e6e4235d645` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:56.064356 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203dd20d-28d3-4843-ac54-9a8f62aaca76 None admin] RBAC: Authorizing `identity:get_user(user_id=5c369ed3953b40509e871e6e4235d645)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:56.065862 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203dd20d-28d3-4843-ac54-9a8f62aaca76 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:56.067434 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 100/195] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:04:55 2022] GET /identity/v3/users/5c369ed3953b40509e871e6e4235d645 => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:56.068166 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dd20d-28d3-4843-ac54-9a8f62aaca76 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:56.148177 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14730dfa-6451-4740-9bb1-141177e8d128 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:56.162483 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dd20d-28d3-4843-ac54-9a8f62aaca76 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:56.163972 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:56.181245 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34f86c-ee84-4d19-bc45-59501f0d5925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:56.181910 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34f86c-ee84-4d19-bc45-59501f0d5925 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:56.182187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34f86c-ee84-4d19-bc45-59501f0d5925 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:56.182462 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34f86c-ee84-4d19-bc45-59501f0d5925 None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:56.183583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34f86c-ee84-4d19-bc45-59501f0d5925 None admin] RBAC: Authorizing `identity:get_project(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:56.185051 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34f86c-ee84-4d19-bc45-59501f0d5925 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:56.186687 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 96/196] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:04:56 2022] GET /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:56.187769 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ba283-72b9-457a-9e89-942aae67ac09 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:56.188050 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ba283-72b9-457a-9e89-942aae67ac09 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:56.188323 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ba283-72b9-457a-9e89-942aae67ac09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:56.203414 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107d224-1e41-403c-a8bb-5fb15cbdbb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:56.204027 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107d224-1e41-403c-a8bb-5fb15cbdbb13 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:56.204297 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107d224-1e41-403c-a8bb-5fb15cbdbb13 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:56.204579 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107d224-1e41-403c-a8bb-5fb15cbdbb13 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:56.205221 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107d224-1e41-403c-a8bb-5fb15cbdbb13 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:56.205435 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-670ba283-72b9-457a-9e89-942aae67ac09 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:56.205549 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107d224-1e41-403c-a8bb-5fb15cbdbb13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:56.206659 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-670ba283-72b9-457a-9e89-942aae67ac09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:56.206933 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107d224-1e41-403c-a8bb-5fb15cbdbb13 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:56.209306 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:56.214968 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 101/197] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:04:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:56.215737 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107d224-1e41-403c-a8bb-5fb15cbdbb13 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:56.279749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 97/198] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:56.280951 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ba283-72b9-457a-9e89-942aae67ac09 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:56.314118 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107d224-1e41-403c-a8bb-5fb15cbdbb13 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:56.349650 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd55402-9033-4db9-b61d-59334c19896f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:56.350442 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd55402-9033-4db9-b61d-59334c19896f None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:56.350782 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd55402-9033-4db9-b61d-59334c19896f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:56.351117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd55402-9033-4db9-b61d-59334c19896f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:56.383499 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ba283-72b9-457a-9e89-942aae67ac09 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:56.383705 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:56.417625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be040433-1493-49bb-95ed-b91b109186fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:56.418257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be040433-1493-49bb-95ed-b91b109186fc None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:56.418526 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be040433-1493-49bb-95ed-b91b109186fc None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:56.418789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be040433-1493-49bb-95ed-b91b109186fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:56.419501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be040433-1493-49bb-95ed-b91b109186fc None admin] RBAC: Adding query filter params (role.id=07d4069c848d4ee9abb586256ee26f20, scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c, user.id=47f211be357548cd82d0a1ef361d8c16) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:56.419858 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be040433-1493-49bb-95ed-b91b109186fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:56.421293 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be040433-1493-49bb-95ed-b91b109186fc None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:56.422611 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd55402-9033-4db9-b61d-59334c19896f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:56.424085 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd55402-9033-4db9-b61d-59334c19896f None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:56.426705 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 98/199] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:04:56 2022] GET /identity/v3/role_assignments?user.id=47f211be357548cd82d0a1ef361d8c16&scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c&role.id=07d4069c848d4ee9abb586256ee26f20 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:56.427798 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be040433-1493-49bb-95ed-b91b109186fc None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:56.432578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:56.550350 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 102/200] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:04:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:04:56.552283 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd55402-9033-4db9-b61d-59334c19896f None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:56.580134 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be040433-1493-49bb-95ed-b91b109186fc None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:56.620296 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:56.624390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e88ae5-c6be-47fb-9f2e-3c0c0267b6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:56.625048 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e88ae5-c6be-47fb-9f2e-3c0c0267b6c2 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:56.625325 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e88ae5-c6be-47fb-9f2e-3c0c0267b6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:56.625594 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e88ae5-c6be-47fb-9f2e-3c0c0267b6c2 None admin] PATH_INFO: `/v3/users/47f211be357548cd82d0a1ef361d8c16` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:56.626812 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e88ae5-c6be-47fb-9f2e-3c0c0267b6c2 None admin] RBAC: Authorizing `identity:get_user(user_id=47f211be357548cd82d0a1ef361d8c16)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:56.628299 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e88ae5-c6be-47fb-9f2e-3c0c0267b6c2 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:56.630146 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 99/201] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:04:56 2022] GET /identity/v3/users/47f211be357548cd82d0a1ef361d8c16 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:56.630782 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e88ae5-c6be-47fb-9f2e-3c0c0267b6c2 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:56.666412 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd55402-9033-4db9-b61d-59334c19896f None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:56.702302 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36c6b8-5124-4e0e-97a7-98500546cd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:56.702933 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36c6b8-5124-4e0e-97a7-98500546cd8f None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:56.703205 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36c6b8-5124-4e0e-97a7-98500546cd8f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:56.703469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36c6b8-5124-4e0e-97a7-98500546cd8f None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:56.705464 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36c6b8-5124-4e0e-97a7-98500546cd8f None admin] RBAC: Authorizing `identity:get_project(project_id=f366603e9ef2405c82fc9fb4c82d1ba0)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:56.706946 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36c6b8-5124-4e0e-97a7-98500546cd8f None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:56.708561 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 103/202] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:04:56 2022] GET /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:56.709315 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36c6b8-5124-4e0e-97a7-98500546cd8f None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:56.709658 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:56.747872 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e88ae5-c6be-47fb-9f2e-3c0c0267b6c2 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:56.783860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace4643-fd7c-4703-9c5a-55608d665bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:56.784840 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace4643-fd7c-4703-9c5a-55608d665bf2 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:56.785316 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace4643-fd7c-4703-9c5a-55608d665bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:56.785937 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace4643-fd7c-4703-9c5a-55608d665bf2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:56.787201 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace4643-fd7c-4703-9c5a-55608d665bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:56.788855 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace4643-fd7c-4703-9c5a-55608d665bf2 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:56.790743 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 100/203] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:04:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:56.791525 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace4643-fd7c-4703-9c5a-55608d665bf2 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:56.816362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36c6b8-5124-4e0e-97a7-98500546cd8f None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:56.849481 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:56.856376 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b848d9-943d-45df-af3b-c7b88cab99b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:56.857500 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b848d9-943d-45df-af3b-c7b88cab99b1 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:56.857837 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b848d9-943d-45df-af3b-c7b88cab99b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:56.858112 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b848d9-943d-45df-af3b-c7b88cab99b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:56.903263 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace4643-fd7c-4703-9c5a-55608d665bf2 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:56.934338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b848d9-943d-45df-af3b-c7b88cab99b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:56.935794 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b848d9-943d-45df-af3b-c7b88cab99b1 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:56.939427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b135e5-d1c5-4e49-8f19-d7f18c684f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:56.940053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b135e5-d1c5-4e49-8f19-d7f18c684f59 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:56.940330 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b135e5-d1c5-4e49-8f19-d7f18c684f59 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:56.940599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b135e5-d1c5-4e49-8f19-d7f18c684f59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:56.942826 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b135e5-d1c5-4e49-8f19-d7f18c684f59 None admin] RBAC: Adding query filter params (role.id=c3cc9c287a1d45e9ad18d3ce7b9975cb, scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0, user.id=5c369ed3953b40509e871e6e4235d645) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:56.942826 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b135e5-d1c5-4e49-8f19-d7f18c684f59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:56.943155 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b135e5-d1c5-4e49-8f19-d7f18c684f59 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:56.950771 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 101/204] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:04:56 2022] GET /identity/v3/role_assignments?user.id=5c369ed3953b40509e871e6e4235d645&scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0&role.id=c3cc9c287a1d45e9ad18d3ce7b9975cb => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:56.951544 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b135e5-d1c5-4e49-8f19-d7f18c684f59 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:56.956054 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:57.051626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 104/205] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:04:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:04:57.057879 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b848d9-943d-45df-af3b-c7b88cab99b1 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:57.067565 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b135e5-d1c5-4e49-8f19-d7f18c684f59 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:57.094110 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:57.103582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b983e79-5c18-48be-8af7-227d292deaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:57.104194 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b983e79-5c18-48be-8af7-227d292deaa9 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:57.104470 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b983e79-5c18-48be-8af7-227d292deaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:57.105058 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b983e79-5c18-48be-8af7-227d292deaa9 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:57.105468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b983e79-5c18-48be-8af7-227d292deaa9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:57.107542 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b983e79-5c18-48be-8af7-227d292deaa9 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:57.132996 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 102/206] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 15:04:56 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:04:57.198974 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b848d9-943d-45df-af3b-c7b88cab99b1 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:57.243362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d71a57-83ba-4242-a4fd-5d7883fe6cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:57.243997 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d71a57-83ba-4242-a4fd-5d7883fe6cf6 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:57.244289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d71a57-83ba-4242-a4fd-5d7883fe6cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:57.244567 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d71a57-83ba-4242-a4fd-5d7883fe6cf6 None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:57.245800 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d71a57-83ba-4242-a4fd-5d7883fe6cf6 None admin] RBAC: Authorizing `identity:get_project(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:57.247258 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d71a57-83ba-4242-a4fd-5d7883fe6cf6 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:57.249282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 105/207] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:04:57 2022] GET /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:57.259482 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b983e79-5c18-48be-8af7-227d292deaa9 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:57.341273 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:57.387303 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b983e79-5c18-48be-8af7-227d292deaa9 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:57.422414 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9e394-7231-4456-b6e1-c109f9b9d0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:57.423079 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9e394-7231-4456-b6e1-c109f9b9d0f8 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:57.423349 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9e394-7231-4456-b6e1-c109f9b9d0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:57.423678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9e394-7231-4456-b6e1-c109f9b9d0f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:57.424435 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9e394-7231-4456-b6e1-c109f9b9d0f8 None admin] RBAC: Adding query filter params (role.id=877977a662dd49daab1ee42ba834153e, scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c, user.id=47f211be357548cd82d0a1ef361d8c16) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:57.424738 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9e394-7231-4456-b6e1-c109f9b9d0f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:57.426251 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9e394-7231-4456-b6e1-c109f9b9d0f8 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:57.432752 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 103/208] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:04:57 2022] GET /identity/v3/role_assignments?user.id=47f211be357548cd82d0a1ef361d8c16&scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c&role.id=877977a662dd49daab1ee42ba834153e => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:58.854469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80755a7b-9a8f-4e1d-b5f8-1bf876c8493a None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:58.854987 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80755a7b-9a8f-4e1d-b5f8-1bf876c8493a None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:58.855274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80755a7b-9a8f-4e1d-b5f8-1bf876c8493a None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:58.857859 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 106/209] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:04:58.867561 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ff04d-d6e9-4077-adc2-ba9ef625c6d5 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:58.868056 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ff04d-d6e9-4077-adc2-ba9ef625c6d5 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:58.868409 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ff04d-d6e9-4077-adc2-ba9ef625c6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:58.893881 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-999ff04d-d6e9-4077-adc2-ba9ef625c6d5 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:58.895510 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-999ff04d-d6e9-4077-adc2-ba9ef625c6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:58.997868 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 104/210] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:04:59.414693 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80755a7b-9a8f-4e1d-b5f8-1bf876c8493a None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:59.591719 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:59.599602 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80755a7b-9a8f-4e1d-b5f8-1bf876c8493a None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:59.665080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4b7ab-efc8-4549-b569-4c100e1fc6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:59.665635 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4b7ab-efc8-4549-b569-4c100e1fc6d4 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:59.665939 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4b7ab-efc8-4549-b569-4c100e1fc6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:59.666485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4b7ab-efc8-4549-b569-4c100e1fc6d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:59.678141 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4b7ab-efc8-4549-b569-4c100e1fc6d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:04:59.683043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-faa4b7ab-efc8-4549-b569-4c100e1fc6d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:04:59.683043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:04:59.683043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:04:59.683043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:04:59.683043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:04:59.683043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:04:59.683043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:04:59.683043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:04:59.683043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:04:59.683043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:04:59.683043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:04:59.683043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:04:59.683043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:04:59.683043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:04:59.683043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:04:59.683043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:04:59.684339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:04:59.684339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:04:59.684339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:04:59.684339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:04:59.684339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:04:59.684339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:04:59.684339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:04:59.684339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:04:59.684339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:04:59.684339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:04:59.684339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:04:59.684339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:04:59.684339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:04:59.684339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:04:59.684339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:04:59.684339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:04:59.685595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:04:59.685595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:04:59.685595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:04:59.685595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:04:59.685595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:04:59.685595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:04:59.685595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:04:59.685595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:04:59.685595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:04:59.685595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:04:59.685595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:04:59.685595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:04:59.685595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 107/211] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 15:04:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:04:59.696297 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ff04d-d6e9-4077-adc2-ba9ef625c6d5 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:59.796024 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:04:59.869661 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ff04d-d6e9-4077-adc2-ba9ef625c6d5 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:04:59.871226 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6348d9-b079-4a33-9d78-9f921cba5c7f None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:59.871753 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6348d9-b079-4a33-9d78-9f921cba5c7f None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:59.872308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6348d9-b079-4a33-9d78-9f921cba5c7f None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:59.873685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 108/212] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:04:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:04:59.880433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d46bc-d4fa-4d8f-bcf5-7d27f575efb5 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:59.880744 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d46bc-d4fa-4d8f-bcf5-7d27f575efb5 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:59.880967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d46bc-d4fa-4d8f-bcf5-7d27f575efb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:59.902728 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-496d46bc-d4fa-4d8f-bcf5-7d27f575efb5 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:04:59.904078 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-496d46bc-d4fa-4d8f-bcf5-7d27f575efb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:04:59.916453 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3a205-3435-4c57-bbdf-f557123e4e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:04:59.917348 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3a205-3435-4c57-bbdf-f557123e4e0d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:04:59.917851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3a205-3435-4c57-bbdf-f557123e4e0d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:04:59.918313 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3a205-3435-4c57-bbdf-f557123e4e0d None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:04:59.919156 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3a205-3435-4c57-bbdf-f557123e4e0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:04:59.919680 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3a205-3435-4c57-bbdf-f557123e4e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:04:59.921293 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3a205-3435-4c57-bbdf-f557123e4e0d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:04:59.930609 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 105/213] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:04:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:04:59.936250 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3a205-3435-4c57-bbdf-f557123e4e0d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:04:59.991655 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 109/214] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:05:00.047593 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3a205-3435-4c57-bbdf-f557123e4e0d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:00.064742 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:00.088003 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446230f8-c88e-41ea-b070-a5c845390176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:00.088643 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446230f8-c88e-41ea-b070-a5c845390176 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:00.088915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446230f8-c88e-41ea-b070-a5c845390176 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:00.089180 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446230f8-c88e-41ea-b070-a5c845390176 None admin] PATH_INFO: `/v3/users/47f211be357548cd82d0a1ef361d8c16` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:00.090347 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446230f8-c88e-41ea-b070-a5c845390176 None admin] RBAC: Authorizing `identity:get_user(user_id=47f211be357548cd82d0a1ef361d8c16)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:00.091794 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446230f8-c88e-41ea-b070-a5c845390176 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:00.093747 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 106/215] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:04:59 2022] GET /identity/v3/users/47f211be357548cd82d0a1ef361d8c16 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:00.102956 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d46bc-d4fa-4d8f-bcf5-7d27f575efb5 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:00.133217 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511ba47-0841-4f12-ae29-451ce08ae091 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:00.133577 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511ba47-0841-4f12-ae29-451ce08ae091 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:00.133888 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511ba47-0841-4f12-ae29-451ce08ae091 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:00.135543 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 107/216] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:05:00.140556 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e20787-fc94-4524-9fe6-d2519468feb1 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:00.140840 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e20787-fc94-4524-9fe6-d2519468feb1 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:00.141106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e20787-fc94-4524-9fe6-d2519468feb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:00.160312 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-b7e20787-fc94-4524-9fe6-d2519468feb1 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:00.161501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-b7e20787-fc94-4524-9fe6-d2519468feb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:00.202332 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:00.219179 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d46bc-d4fa-4d8f-bcf5-7d27f575efb5 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:00.255453 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 108/217] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:05:00.256774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f80dc-3065-419a-bd1e-4bc0478cbe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:00.257639 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f80dc-3065-419a-bd1e-4bc0478cbe33 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:00.258161 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f80dc-3065-419a-bd1e-4bc0478cbe33 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:00.258727 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f80dc-3065-419a-bd1e-4bc0478cbe33 None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:00.260044 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f80dc-3065-419a-bd1e-4bc0478cbe33 None admin] RBAC: Authorizing `identity:get_project(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:00.261769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f80dc-3065-419a-bd1e-4bc0478cbe33 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:00.263815 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 110/218] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:00 2022] GET /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:00.269613 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e20787-fc94-4524-9fe6-d2519468feb1 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:00.301927 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f2c33-033f-4e08-bbeb-fbafceeb6494 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:00.302361 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f2c33-033f-4e08-bbeb-fbafceeb6494 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:00.302876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f2c33-033f-4e08-bbeb-fbafceeb6494 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:00.305190 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 111/219] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:00.312697 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bf3f5-986c-40d9-81b6-f82765ebb048 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:00.312974 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bf3f5-986c-40d9-81b6-f82765ebb048 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:00.313245 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bf3f5-986c-40d9-81b6-f82765ebb048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:00.335473 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-744bf3f5-986c-40d9-81b6-f82765ebb048 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:00.337265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-744bf3f5-986c-40d9-81b6-f82765ebb048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:00.392047 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e20787-fc94-4524-9fe6-d2519468feb1 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:00.411119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:00.421418 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 112/220] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:00.422200 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bf3f5-986c-40d9-81b6-f82765ebb048 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:00.442919 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba832604-00af-4866-a201-72244bef657d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:00.443500 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba832604-00af-4866-a201-72244bef657d None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:00.443774 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba832604-00af-4866-a201-72244bef657d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:00.444040 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba832604-00af-4866-a201-72244bef657d None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c/users/47f211be357548cd82d0a1ef361d8c16/roles/07d4069c848d4ee9abb586256ee26f20` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:00.446191 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba832604-00af-4866-a201-72244bef657d None admin] RBAC: Authorizing `identity:create_grant(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c, user_id=47f211be357548cd82d0a1ef361d8c16, role_id=07d4069c848d4ee9abb586256ee26f20)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:00.447695 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba832604-00af-4866-a201-72244bef657d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:00.469801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 109/221] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 15:05:00 2022] PUT /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c/users/47f211be357548cd82d0a1ef361d8c16/roles/07d4069c848d4ee9abb586256ee26f20 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:05:00.534782 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:00.548405 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bf3f5-986c-40d9-81b6-f82765ebb048 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:00.585433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56653637-292d-4b98-a96c-31ad024b2814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:00.586145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56653637-292d-4b98-a96c-31ad024b2814 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:00.586478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56653637-292d-4b98-a96c-31ad024b2814 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:00.586746 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56653637-292d-4b98-a96c-31ad024b2814 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:00.587955 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56653637-292d-4b98-a96c-31ad024b2814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:00.589404 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56653637-292d-4b98-a96c-31ad024b2814 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:00.592863 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba832604-00af-4866-a201-72244bef657d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:00.595848 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 113/222] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:00.601950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56653637-292d-4b98-a96c-31ad024b2814 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:00.726837 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56653637-292d-4b98-a96c-31ad024b2814 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:00.742704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba832604-00af-4866-a201-72244bef657d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:00.774680 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c041d-de5d-4be0-bdfa-c5b727bdb41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:00.775286 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c041d-de5d-4be0-bdfa-c5b727bdb41e None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:00.775557 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c041d-de5d-4be0-bdfa-c5b727bdb41e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:00.775819 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c041d-de5d-4be0-bdfa-c5b727bdb41e None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:00.776466 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c041d-de5d-4be0-bdfa-c5b727bdb41e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:00.777939 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c041d-de5d-4be0-bdfa-c5b727bdb41e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:00.781708 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779ec86-f422-406e-a98a-3eeda8b61b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:00.782589 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779ec86-f422-406e-a98a-3eeda8b61b1d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:00.783051 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779ec86-f422-406e-a98a-3eeda8b61b1d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:00.783503 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779ec86-f422-406e-a98a-3eeda8b61b1d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:00.798664 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779ec86-f422-406e-a98a-3eeda8b61b1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:00.802629 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 114/223] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 15:05:00 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:05:00.804557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-9779ec86-f422-406e-a98a-3eeda8b61b1d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:05:00.804557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:00.804557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:00.804557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:00.804557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:00.804557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:00.804557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:00.804557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:00.804557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:00.804557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:00.804557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:00.804557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:00.804557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:00.804557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:00.804557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:00.804557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:00.805555 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:00.805555 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:00.805555 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:00.805555 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:00.805555 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:00.805555 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:00.805555 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:00.805555 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:00.805555 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:00.805555 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:00.805555 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:00.805555 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:00.805555 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:00.805555 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:00.805555 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:00.805555 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:00.806410 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:00.806410 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:00.806410 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:00.806410 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:00.806410 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:00.806410 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:00.806410 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:00.806410 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:00.806410 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:00.806410 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:00.806410 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:05:00.806410 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:00.809106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 110/224] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 15:05:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:05:00.814903 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c041d-de5d-4be0-bdfa-c5b727bdb41e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:00.832185 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:00.882887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779ec86-f422-406e-a98a-3eeda8b61b1d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:00.926938 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:00.940679 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c041d-de5d-4be0-bdfa-c5b727bdb41e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:00.978977 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332b530-945e-436e-9f33-fdc0e5878aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:00.979520 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332b530-945e-436e-9f33-fdc0e5878aae None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:00.979797 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332b530-945e-436e-9f33-fdc0e5878aae None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:00.980066 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332b530-945e-436e-9f33-fdc0e5878aae None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:00.980742 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332b530-945e-436e-9f33-fdc0e5878aae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:00.981043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332b530-945e-436e-9f33-fdc0e5878aae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:00.982850 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332b530-945e-436e-9f33-fdc0e5878aae None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:00.993108 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 115/225] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:05:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:00.998915 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332b530-945e-436e-9f33-fdc0e5878aae None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:01.019466 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779ec86-f422-406e-a98a-3eeda8b61b1d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:01.057725 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe003f8-b423-448c-907e-25b9c0b6b101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:01.058409 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe003f8-b423-448c-907e-25b9c0b6b101 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:01.058662 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe003f8-b423-448c-907e-25b9c0b6b101 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:01.058927 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe003f8-b423-448c-907e-25b9c0b6b101 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:01.072552 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe003f8-b423-448c-907e-25b9c0b6b101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:01.080637 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-7fe003f8-b423-448c-907e-25b9c0b6b101 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:01.080637 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:01.080637 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:01.080637 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:01.080637 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:01.080637 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:01.080637 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:01.080637 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:01.080637 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:01.080637 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:01.080637 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:01.080637 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:01.080637 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:01.080637 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:01.080637 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:01.080637 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:01.081542 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:01.081542 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:01.081542 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:01.081542 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:01.081542 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:01.081542 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:01.081542 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:01.081542 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:01.081542 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:01.081542 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:01.081542 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:01.081542 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:01.081542 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:01.081542 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:01.081542 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:01.081542 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:01.082389 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:01.082389 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:01.082389 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:01.082389 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:01.082389 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:01.082389 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:01.082389 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:01.082389 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:01.082389 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:01.082389 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:01.082389 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:01.082389 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:01.082389 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 111/226] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:01.089869 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe003f8-b423-448c-907e-25b9c0b6b101 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:01.100782 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:01.133032 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332b530-945e-436e-9f33-fdc0e5878aae None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:01.175216 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fc8d1-9939-496d-a7be-d22e2d395904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:01.175860 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fc8d1-9939-496d-a7be-d22e2d395904 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:01.177058 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fc8d1-9939-496d-a7be-d22e2d395904 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:01.177343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fc8d1-9939-496d-a7be-d22e2d395904 None admin] PATH_INFO: `/v3/users/47f211be357548cd82d0a1ef361d8c16` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:01.178547 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378fc8d1-9939-496d-a7be-d22e2d395904 None admin] RBAC: Authorizing `identity:get_user(user_id=47f211be357548cd82d0a1ef361d8c16)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:01.180005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378fc8d1-9939-496d-a7be-d22e2d395904 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:01.182157 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 116/227] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:05:00 2022] GET /identity/v3/users/47f211be357548cd82d0a1ef361d8c16 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:01.187741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fc8d1-9939-496d-a7be-d22e2d395904 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:01.214171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:01.224733 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe003f8-b423-448c-907e-25b9c0b6b101 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:01.268460 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a93bfd-8647-4bab-98a5-2b92ea27da2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:01.269297 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a93bfd-8647-4bab-98a5-2b92ea27da2a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:01.269729 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a93bfd-8647-4bab-98a5-2b92ea27da2a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:01.270165 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a93bfd-8647-4bab-98a5-2b92ea27da2a None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:01.271052 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a93bfd-8647-4bab-98a5-2b92ea27da2a None admin] RBAC: Adding query filter params (name=member) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:01.271591 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a93bfd-8647-4bab-98a5-2b92ea27da2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:01.273106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a93bfd-8647-4bab-98a5-2b92ea27da2a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:01.283777 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 112/228] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:05:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:01.289345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a93bfd-8647-4bab-98a5-2b92ea27da2a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:01.309396 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fc8d1-9939-496d-a7be-d22e2d395904 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:01.353563 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fe234-fcdf-4866-aa33-33efb5e16fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:01.354475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fe234-fcdf-4866-aa33-33efb5e16fd4 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:01.355092 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fe234-fcdf-4866-aa33-33efb5e16fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:01.356263 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fe234-fcdf-4866-aa33-33efb5e16fd4 None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:01.358709 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3fe234-fcdf-4866-aa33-33efb5e16fd4 None admin] RBAC: Authorizing `identity:get_project(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:01.361213 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3fe234-fcdf-4866-aa33-33efb5e16fd4 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:01.364012 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 117/229] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:01 2022] GET /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:01.369440 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fe234-fcdf-4866-aa33-33efb5e16fd4 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:01.387026 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:01.416215 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a93bfd-8647-4bab-98a5-2b92ea27da2a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:01.451585 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d3f21-1b4b-4574-8b06-ecb63377a9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:01.452564 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d3f21-1b4b-4574-8b06-ecb63377a9f4 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:01.453028 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d3f21-1b4b-4574-8b06-ecb63377a9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:01.453483 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d3f21-1b4b-4574-8b06-ecb63377a9f4 None admin] PATH_INFO: `/v3/users/c2441b13b85c4a459df640a938406157` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:01.467962 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d3f21-1b4b-4574-8b06-ecb63377a9f4 None admin] RBAC: Authorizing `identity:get_user(user_id=c2441b13b85c4a459df640a938406157)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:01.469940 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d3f21-1b4b-4574-8b06-ecb63377a9f4 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:01.472872 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 113/230] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:05:01 2022] GET /identity/v3/users/c2441b13b85c4a459df640a938406157 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:01.477987 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d3f21-1b4b-4574-8b06-ecb63377a9f4 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:01.487723 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fe234-fcdf-4866-aa33-33efb5e16fd4 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:01.507693 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:01.546492 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29232b-ef7e-40d6-ba18-ff53385ef20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:01.547080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29232b-ef7e-40d6-ba18-ff53385ef20d None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:01.547352 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29232b-ef7e-40d6-ba18-ff53385ef20d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:01.547619 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29232b-ef7e-40d6-ba18-ff53385ef20d None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c/users/47f211be357548cd82d0a1ef361d8c16/roles/877977a662dd49daab1ee42ba834153e` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:01.553554 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29232b-ef7e-40d6-ba18-ff53385ef20d None admin] RBAC: Authorizing `identity:create_grant(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c, user_id=47f211be357548cd82d0a1ef361d8c16, role_id=877977a662dd49daab1ee42ba834153e)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:01.555176 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29232b-ef7e-40d6-ba18-ff53385ef20d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:01.576679 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 118/231] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 15:05:01 2022] PUT /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c/users/47f211be357548cd82d0a1ef361d8c16/roles/877977a662dd49daab1ee42ba834153e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:05:01.668938 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d3f21-1b4b-4574-8b06-ecb63377a9f4 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:01.734602 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ceaf1-7dbf-41db-ad64-96ac202ce306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:01.735242 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ceaf1-7dbf-41db-ad64-96ac202ce306 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:01.735516 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ceaf1-7dbf-41db-ad64-96ac202ce306 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:01.735784 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ceaf1-7dbf-41db-ad64-96ac202ce306 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:01.825912 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ceaf1-7dbf-41db-ad64-96ac202ce306 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:01.827392 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ceaf1-7dbf-41db-ad64-96ac202ce306 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:01.843386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:01.943673 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 114/232] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 15:05:01.949424 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29232b-ef7e-40d6-ba18-ff53385ef20d None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:02.057721 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:02.112030 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29232b-ef7e-40d6-ba18-ff53385ef20d None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:02.146562 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20efbfa-3faa-4a80-98bf-b7319cc9447f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:02.147544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20efbfa-3faa-4a80-98bf-b7319cc9447f None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:02.148037 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20efbfa-3faa-4a80-98bf-b7319cc9447f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:02.148565 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20efbfa-3faa-4a80-98bf-b7319cc9447f None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:02.150020 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20efbfa-3faa-4a80-98bf-b7319cc9447f None admin] RBAC: Authorizing `identity:get_project(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:02.151705 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20efbfa-3faa-4a80-98bf-b7319cc9447f None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:02.153547 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 119/233] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:01 2022] GET /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:02.161309 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ceaf1-7dbf-41db-ad64-96ac202ce306 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:02.288588 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ceaf1-7dbf-41db-ad64-96ac202ce306 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:02.312315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:02.348301 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925b1c6-8f08-4cae-bfbe-91289134c057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:02.348978 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925b1c6-8f08-4cae-bfbe-91289134c057 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:02.349357 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925b1c6-8f08-4cae-bfbe-91289134c057 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:02.349628 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925b1c6-8f08-4cae-bfbe-91289134c057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:02.350376 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925b1c6-8f08-4cae-bfbe-91289134c057 None admin] RBAC: Adding query filter params (role.id=dfd00108a3dd42f1a9dd0335f4b8f508, scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c, user.id=c2441b13b85c4a459df640a938406157) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:02.350677 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925b1c6-8f08-4cae-bfbe-91289134c057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:02.352176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925b1c6-8f08-4cae-bfbe-91289134c057 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:02.362595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 115/234] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:05:02 2022] GET /identity/v3/role_assignments?user.id=c2441b13b85c4a459df640a938406157&scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c&role.id=dfd00108a3dd42f1a9dd0335f4b8f508 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:03.449348 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d8a10-2a49-4743-aa25-dc5ddc9b1db6 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:03.450060 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d8a10-2a49-4743-aa25-dc5ddc9b1db6 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:03.450060 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d8a10-2a49-4743-aa25-dc5ddc9b1db6 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:03.451250 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 120/235] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:03.457210 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef606855-fb7e-4fa2-805c-fd3c6f30426e None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:03.457773 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef606855-fb7e-4fa2-805c-fd3c6f30426e None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:03.457773 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef606855-fb7e-4fa2-805c-fd3c6f30426e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:03.480084 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-ef606855-fb7e-4fa2-805c-fd3c6f30426e None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:03.481267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-ef606855-fb7e-4fa2-805c-fd3c6f30426e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:03.570671 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 116/236] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:03.906065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d8a10-2a49-4743-aa25-dc5ddc9b1db6 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:04.071583 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d8a10-2a49-4743-aa25-dc5ddc9b1db6 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:04.127234 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a6ce6-3893-49f7-9c19-0fb26600a4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:04.128559 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a6ce6-3893-49f7-9c19-0fb26600a4d7 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:04.129188 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a6ce6-3893-49f7-9c19-0fb26600a4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:04.129866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a6ce6-3893-49f7-9c19-0fb26600a4d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:04.144902 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a6ce6-3893-49f7-9c19-0fb26600a4d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:04.151123 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:04.154050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-ba0a6ce6-3893-49f7-9c19-0fb26600a4d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:05:04.154050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:04.154050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:04.154050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:04.154050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:04.154050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:04.154050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:04.154050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:04.154050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:04.154050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:04.154050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:04.154050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:04.154050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:04.154050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:04.154050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:04.154050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:04.154930 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:04.154930 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:04.154930 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:04.154930 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:04.154930 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:04.154930 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:04.154930 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:04.154930 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:04.154930 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:04.154930 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:04.154930 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:04.154930 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:04.154930 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:04.154930 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:04.154930 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:04.154930 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:04.155728 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:04.155728 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:04.155728 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:04.155728 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:04.155728 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:04.155728 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:04.155728 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:04.155728 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:04.155728 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:04.155728 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:04.155728 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:05:04.155728 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:04.158997 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 121/237] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 15:05:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:04.171517 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef606855-fb7e-4fa2-805c-fd3c6f30426e None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:04.283483 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4d1f2-1450-4fcb-82c7-b82fd56c4ecb None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:04.283844 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4d1f2-1450-4fcb-82c7-b82fd56c4ecb None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:04.284016 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4d1f2-1450-4fcb-82c7-b82fd56c4ecb None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:04.285615 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 122/238] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:04.291691 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09390af-2e15-4f9e-8658-32eeb2b5e582 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:04.291974 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09390af-2e15-4f9e-8658-32eeb2b5e582 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:04.292249 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09390af-2e15-4f9e-8658-32eeb2b5e582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:04.292832 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef606855-fb7e-4fa2-805c-fd3c6f30426e None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:04.303467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:04.328132 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-e09390af-2e15-4f9e-8658-32eeb2b5e582 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:04.329240 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-e09390af-2e15-4f9e-8658-32eeb2b5e582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:04.331507 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46bde7-a001-4937-b892-ca8c19a75505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:04.332134 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46bde7-a001-4937-b892-ca8c19a75505 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:04.332413 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46bde7-a001-4937-b892-ca8c19a75505 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:04.332684 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46bde7-a001-4937-b892-ca8c19a75505 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:04.333405 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46bde7-a001-4937-b892-ca8c19a75505 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:04.333730 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46bde7-a001-4937-b892-ca8c19a75505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:04.335180 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46bde7-a001-4937-b892-ca8c19a75505 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:04.345148 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 117/239] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:04.351666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46bde7-a001-4937-b892-ca8c19a75505 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:04.460211 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 123/240] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:04.505589 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46bde7-a001-4937-b892-ca8c19a75505 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:04.538999 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934bfc7-cc19-4f57-bac6-caa9ab17f467 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:04.539302 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934bfc7-cc19-4f57-bac6-caa9ab17f467 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:04.539575 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934bfc7-cc19-4f57-bac6-caa9ab17f467 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:04.541134 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 124/241] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:05:04.543604 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16cf54-19e3-4f39-bfe6-d5e2033cafa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:04.544249 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16cf54-19e3-4f39-bfe6-d5e2033cafa2 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:04.544525 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16cf54-19e3-4f39-bfe6-d5e2033cafa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:04.544856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16cf54-19e3-4f39-bfe6-d5e2033cafa2 None admin] PATH_INFO: `/v3/users/47f211be357548cd82d0a1ef361d8c16` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:04.545968 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16cf54-19e3-4f39-bfe6-d5e2033cafa2 None admin] RBAC: Authorizing `identity:get_user(user_id=47f211be357548cd82d0a1ef361d8c16)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:04.547433 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16cf54-19e3-4f39-bfe6-d5e2033cafa2 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:04.549286 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 118/242] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:05:04 2022] GET /identity/v3/users/47f211be357548cd82d0a1ef361d8c16 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:04.555522 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f48610-27c7-4c4d-816c-141788f63239 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:04.555807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f48610-27c7-4c4d-816c-141788f63239 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:04.556097 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f48610-27c7-4c4d-816c-141788f63239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:04.566758 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16cf54-19e3-4f39-bfe6-d5e2033cafa2 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:04.587056 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-13f48610-27c7-4c4d-816c-141788f63239 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:04.590376 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-13f48610-27c7-4c4d-816c-141788f63239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:04.644646 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:04.694950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 125/243] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:05:04.765399 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16cf54-19e3-4f39-bfe6-d5e2033cafa2 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:04.810147 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2cdc0-1d84-41fc-9b22-b245f32e6055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:04.810765 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2cdc0-1d84-41fc-9b22-b245f32e6055 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:04.811043 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2cdc0-1d84-41fc-9b22-b245f32e6055 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:04.811311 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2cdc0-1d84-41fc-9b22-b245f32e6055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:04.841002 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f48610-27c7-4c4d-816c-141788f63239 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:04.926667 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2cdc0-1d84-41fc-9b22-b245f32e6055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:04.929753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2cdc0-1d84-41fc-9b22-b245f32e6055 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:04.944201 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:04.992721 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f48610-27c7-4c4d-816c-141788f63239 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:05.025673 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:05.047142 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44c7bf-4919-4cfa-aa1a-02a901b5d4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:05.047779 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44c7bf-4919-4cfa-aa1a-02a901b5d4a0 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:05.048051 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44c7bf-4919-4cfa-aa1a-02a901b5d4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:05.048316 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44c7bf-4919-4cfa-aa1a-02a901b5d4a0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:05.059122 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44c7bf-4919-4cfa-aa1a-02a901b5d4a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:05.064061 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-bc44c7bf-4919-4cfa-aa1a-02a901b5d4a0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:05:05.064061 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:05.064061 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:05.064061 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:05.064061 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:05.064061 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:05.064061 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:05.064061 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:05.064061 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:05.064061 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:05.064061 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:05.064061 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:05.064061 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:05.064061 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:05.064061 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:05.064061 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:05.064938 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:05.064938 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:05.064938 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:05.064938 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:05.064938 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:05.064938 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:05.064938 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:05.064938 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:05.064938 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:05.064938 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:05.064938 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:05.064938 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:05.064938 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:05.064938 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:05.064938 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:05.064938 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:05.065754 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:05.065754 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:05.065754 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:05.065754 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:05.065754 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:05.065754 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:05.065754 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:05.065754 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:05.065754 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:05.065754 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:05.065754 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:05:05.065754 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:05.065754 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 126/244] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:05:05.066967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab855e-9085-41a1-8952-83bf7d612a83 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:05.067222 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab855e-9085-41a1-8952-83bf7d612a83 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:05.067493 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab855e-9085-41a1-8952-83bf7d612a83 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:05.072942 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 127/245] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:05.073774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab855e-9085-41a1-8952-83bf7d612a83 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:05.100537 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 119/246] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:05.102260 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f0a6a-2f57-4da0-84cd-d9f2a474fd38 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:05.102733 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f0a6a-2f57-4da0-84cd-d9f2a474fd38 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:05.103192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f0a6a-2f57-4da0-84cd-d9f2a474fd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:05.122462 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-f66f0a6a-2f57-4da0-84cd-d9f2a474fd38 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:05.124022 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-f66f0a6a-2f57-4da0-84cd-d9f2a474fd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:05.179238 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab855e-9085-41a1-8952-83bf7d612a83 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:05.194264 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 120/247] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:05.195277 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f0a6a-2f57-4da0-84cd-d9f2a474fd38 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:05.201302 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:05.223063 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fccd49-6205-4232-9b0b-8d2c2bab5e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:05.223832 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fccd49-6205-4232-9b0b-8d2c2bab5e56 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:05.224204 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fccd49-6205-4232-9b0b-8d2c2bab5e56 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:05.224820 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fccd49-6205-4232-9b0b-8d2c2bab5e56 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:05.226041 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fccd49-6205-4232-9b0b-8d2c2bab5e56 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:05.226448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fccd49-6205-4232-9b0b-8d2c2bab5e56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:05.228463 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fccd49-6205-4232-9b0b-8d2c2bab5e56 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:05.240192 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 128/248] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:05:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:05.241234 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fccd49-6205-4232-9b0b-8d2c2bab5e56 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:05.273446 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:05.311999 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f0a6a-2f57-4da0-84cd-d9f2a474fd38 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:05.348466 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff2a79-efa5-48ef-b242-86e55af6f62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:05.349212 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff2a79-efa5-48ef-b242-86e55af6f62e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:05.349467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff2a79-efa5-48ef-b242-86e55af6f62e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:05.349760 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff2a79-efa5-48ef-b242-86e55af6f62e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:05.350940 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff2a79-efa5-48ef-b242-86e55af6f62e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:05.352433 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff2a79-efa5-48ef-b242-86e55af6f62e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:05.354370 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 121/249] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:05.359413 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff2a79-efa5-48ef-b242-86e55af6f62e None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:05.381460 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fccd49-6205-4232-9b0b-8d2c2bab5e56 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:05.427234 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7d25e-5845-479b-aac2-01e767a9a25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:05.427873 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7d25e-5845-479b-aac2-01e767a9a25a None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:05.428371 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7d25e-5845-479b-aac2-01e767a9a25a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:05.428636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7d25e-5845-479b-aac2-01e767a9a25a None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:05.430427 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7d25e-5845-479b-aac2-01e767a9a25a None admin] RBAC: Authorizing `identity:get_project(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:05.432373 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7d25e-5845-479b-aac2-01e767a9a25a None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:05.435466 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 129/250] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:05 2022] GET /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:05.437519 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7d25e-5845-479b-aac2-01e767a9a25a None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:05.474263 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff2a79-efa5-48ef-b242-86e55af6f62e None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:05.495312 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:05.516936 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56fb0c-158e-487b-8bc0-8cd0621c2b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:05.517572 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56fb0c-158e-487b-8bc0-8cd0621c2b98 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:05.517873 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56fb0c-158e-487b-8bc0-8cd0621c2b98 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:05.518141 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56fb0c-158e-487b-8bc0-8cd0621c2b98 None admin] PATH_INFO: `/v3/users/e21aeced52f443ba89dc80fa7f19b1ef` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:05.520899 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:05.531999 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56fb0c-158e-487b-8bc0-8cd0621c2b98 None admin] RBAC: Authorizing `identity:get_user(user_id=e21aeced52f443ba89dc80fa7f19b1ef)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:05.533484 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56fb0c-158e-487b-8bc0-8cd0621c2b98 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:05.535147 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 122/251] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:05:05 2022] GET /identity/v3/users/e21aeced52f443ba89dc80fa7f19b1ef => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:05.535948 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56fb0c-158e-487b-8bc0-8cd0621c2b98 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:05.550975 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7d25e-5845-479b-aac2-01e767a9a25a None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:05.583378 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e62c4-3c06-4fe0-bb10-d0e5b56a1052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:05.584043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e62c4-3c06-4fe0-bb10-d0e5b56a1052 None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:05.584322 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e62c4-3c06-4fe0-bb10-d0e5b56a1052 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:05.584591 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e62c4-3c06-4fe0-bb10-d0e5b56a1052 None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:05.585233 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e62c4-3c06-4fe0-bb10-d0e5b56a1052 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:05.586750 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e62c4-3c06-4fe0-bb10-d0e5b56a1052 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:05.610475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 130/252] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 15:05:05 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:05:05.611626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0561a5b-cfe4-436e-904a-cac6e56e9096 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:05.611906 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0561a5b-cfe4-436e-904a-cac6e56e9096 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:05.612208 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0561a5b-cfe4-436e-904a-cac6e56e9096 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:05.613488 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 131/253] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:05.618787 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0561a5b-cfe4-436e-904a-cac6e56e9096 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:05.653887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56fb0c-158e-487b-8bc0-8cd0621c2b98 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:05.692940 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a67edc-1d8c-4955-ae38-259cf42666cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:05.693567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a67edc-1d8c-4955-ae38-259cf42666cf None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:05.693879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a67edc-1d8c-4955-ae38-259cf42666cf None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:05.694151 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a67edc-1d8c-4955-ae38-259cf42666cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:05.694879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a67edc-1d8c-4955-ae38-259cf42666cf None admin] RBAC: Adding query filter params (role.id=07d4069c848d4ee9abb586256ee26f20, scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c, user.id=47f211be357548cd82d0a1ef361d8c16) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:05.695187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a67edc-1d8c-4955-ae38-259cf42666cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:05.696751 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a67edc-1d8c-4955-ae38-259cf42666cf None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:05.713742 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 123/254] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:05:05 2022] GET /identity/v3/role_assignments?user.id=47f211be357548cd82d0a1ef361d8c16&scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c&role.id=07d4069c848d4ee9abb586256ee26f20 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:05.713742 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a67edc-1d8c-4955-ae38-259cf42666cf None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:05.752416 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0561a5b-cfe4-436e-904a-cac6e56e9096 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:05.755507 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:05.784580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:05.800818 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f051d-b5c6-4261-965f-ce7274179214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:05.801726 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f051d-b5c6-4261-965f-ce7274179214 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:05.802108 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f051d-b5c6-4261-965f-ce7274179214 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:05.802478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f051d-b5c6-4261-965f-ce7274179214 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:05.818685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f051d-b5c6-4261-965f-ce7274179214 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:05.825485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-9b8f051d-b5c6-4261-965f-ce7274179214 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:05:05.825485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:05.825485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:05.825485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:05.825485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:05.825485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:05.825485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:05.825485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:05.825485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:05.825485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:05.825485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:05.825485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:05.825485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:05.825485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:05.825485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:05.825485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:05.826684 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:05.826684 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:05.826684 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:05.826684 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:05.826684 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:05.826684 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:05.826684 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:05.826684 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:05.826684 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:05.826684 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:05.826684 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:05.826684 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:05.826684 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:05.826684 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:05.826684 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:05.826684 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:05.827497 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:05.827497 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:05.827497 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:05.827497 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:05.827497 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:05.827497 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:05.827497 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:05.827497 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:05.827497 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:05.827497 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:05.827497 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:05:05.827497 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:05.828113 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 132/255] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 15:05:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:05.829999 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06023caa-c8e5-49a3-a20c-00fd6121f061 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:05.830409 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06023caa-c8e5-49a3-a20c-00fd6121f061 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:05.831279 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06023caa-c8e5-49a3-a20c-00fd6121f061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:05.841562 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a67edc-1d8c-4955-ae38-259cf42666cf None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:05.856234 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-06023caa-c8e5-49a3-a20c-00fd6121f061 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:05.858073 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-06023caa-c8e5-49a3-a20c-00fd6121f061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:05.885383 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4b191-d557-4736-b285-09a822a90fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:05.886128 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4b191-d557-4736-b285-09a822a90fb1 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:05.886408 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4b191-d557-4736-b285-09a822a90fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:05.886797 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4b191-d557-4736-b285-09a822a90fb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:05.957554 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 133/256] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:05.960649 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06023caa-c8e5-49a3-a20c-00fd6121f061 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:05.988994 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4b191-d557-4736-b285-09a822a90fb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:05.991296 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4b191-d557-4736-b285-09a822a90fb1 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:06.066616 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:06.092475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:06.100900 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06023caa-c8e5-49a3-a20c-00fd6121f061 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:06.120264 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 124/257] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:06.125959 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4b191-d557-4736-b285-09a822a90fb1 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:06.137870 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b99c2-78b3-46f0-b3a4-ed82f5fdbb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:06.138799 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b99c2-78b3-46f0-b3a4-ed82f5fdbb66 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:06.139271 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b99c2-78b3-46f0-b3a4-ed82f5fdbb66 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:06.139731 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b99c2-78b3-46f0-b3a4-ed82f5fdbb66 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:06.140602 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b99c2-78b3-46f0-b3a4-ed82f5fdbb66 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:06.141109 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b99c2-78b3-46f0-b3a4-ed82f5fdbb66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:06.142609 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b99c2-78b3-46f0-b3a4-ed82f5fdbb66 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:06.152855 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 134/258] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:05:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:06.162655 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b99c2-78b3-46f0-b3a4-ed82f5fdbb66 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:06.257046 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4b191-d557-4736-b285-09a822a90fb1 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:06.318395 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb03cd1-c8e6-4c8a-8890-477dc89e6136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:06.319446 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb03cd1-c8e6-4c8a-8890-477dc89e6136 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:06.320895 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb03cd1-c8e6-4c8a-8890-477dc89e6136 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:06.321374 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb03cd1-c8e6-4c8a-8890-477dc89e6136 None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:06.323348 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb03cd1-c8e6-4c8a-8890-477dc89e6136 None admin] RBAC: Authorizing `identity:get_project(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:06.327397 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b99c2-78b3-46f0-b3a4-ed82f5fdbb66 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:06.327875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb03cd1-c8e6-4c8a-8890-477dc89e6136 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:06.329873 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 125/259] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:06 2022] GET /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:06.330843 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb03cd1-c8e6-4c8a-8890-477dc89e6136 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:06.362618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:06.375574 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0248e-30ea-41d5-93cf-cf5442d62e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:06.376212 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0248e-30ea-41d5-93cf-cf5442d62e30 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:06.376481 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0248e-30ea-41d5-93cf-cf5442d62e30 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:06.376743 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0248e-30ea-41d5-93cf-cf5442d62e30 None admin] PATH_INFO: `/v3/users/47f211be357548cd82d0a1ef361d8c16` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:06.377906 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0248e-30ea-41d5-93cf-cf5442d62e30 None admin] RBAC: Authorizing `identity:get_user(user_id=47f211be357548cd82d0a1ef361d8c16)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:06.379362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0248e-30ea-41d5-93cf-cf5442d62e30 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:06.381681 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 135/260] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:05:06 2022] GET /identity/v3/users/47f211be357548cd82d0a1ef361d8c16 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:06.382451 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0248e-30ea-41d5-93cf-cf5442d62e30 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:06.413160 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:06.449211 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb03cd1-c8e6-4c8a-8890-477dc89e6136 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:06.487155 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0e7de-90c0-4dea-9b98-1786386c8982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:06.488469 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0e7de-90c0-4dea-9b98-1786386c8982 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:06.488993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0e7de-90c0-4dea-9b98-1786386c8982 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:06.489455 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0e7de-90c0-4dea-9b98-1786386c8982 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:06.500088 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0e7de-90c0-4dea-9b98-1786386c8982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:06.500232 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0248e-30ea-41d5-93cf-cf5442d62e30 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:06.506220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-84a0e7de-90c0-4dea-9b98-1786386c8982 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:06.506220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:06.506220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:06.506220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:06.506220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:06.506220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:06.506220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:06.506220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:06.506220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:06.506220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:06.506220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:06.506220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:06.506220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:06.506220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:06.506220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:06.506220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:06.507106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:06.507106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:06.507106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:06.507106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:06.507106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:06.507106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:06.507106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:06.507106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:06.507106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:06.507106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:06.507106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:06.507106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:06.507106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:06.507106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:06.507106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:06.507106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:06.507915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:06.507915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:06.507915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:06.507915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:06.507915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:06.507915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:06.507915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:06.507915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:06.507915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:06.507915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:06.507915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:06.507915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:06.515222 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 126/261] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:06.516303 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0e7de-90c0-4dea-9b98-1786386c8982 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:06.537599 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f964e3-a795-4f68-a639-a4ad8f096621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:06.538237 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f964e3-a795-4f68-a639-a4ad8f096621 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:06.538515 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f964e3-a795-4f68-a639-a4ad8f096621 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:06.538782 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f964e3-a795-4f68-a639-a4ad8f096621 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:06.539534 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f964e3-a795-4f68-a639-a4ad8f096621 None admin] RBAC: Adding query filter params (role.id=c3cc9c287a1d45e9ad18d3ce7b9975cb, scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c, user.id=e21aeced52f443ba89dc80fa7f19b1ef) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:06.539835 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f964e3-a795-4f68-a639-a4ad8f096621 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:06.541765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f964e3-a795-4f68-a639-a4ad8f096621 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:06.549012 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 136/262] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:05:06 2022] GET /identity/v3/role_assignments?user.id=e21aeced52f443ba89dc80fa7f19b1ef&scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c&role.id=c3cc9c287a1d45e9ad18d3ce7b9975cb => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:06.558424 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f964e3-a795-4f68-a639-a4ad8f096621 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:06.615036 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:06.630368 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0e7de-90c0-4dea-9b98-1786386c8982 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:06.669192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8200ec4-2ee9-4ea3-a2c7-3931ad4c7f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:06.670211 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8200ec4-2ee9-4ea3-a2c7-3931ad4c7f3b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:06.670687 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8200ec4-2ee9-4ea3-a2c7-3931ad4c7f3b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:06.671151 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8200ec4-2ee9-4ea3-a2c7-3931ad4c7f3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:06.718329 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:06.750137 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f964e3-a795-4f68-a639-a4ad8f096621 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:06.753778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8200ec4-2ee9-4ea3-a2c7-3931ad4c7f3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:06.755514 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8200ec4-2ee9-4ea3-a2c7-3931ad4c7f3b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:06.815515 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46afc76-faf0-4ddb-a00b-d1942c80a277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:06.816138 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46afc76-faf0-4ddb-a00b-d1942c80a277 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:06.816415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46afc76-faf0-4ddb-a00b-d1942c80a277 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:06.816678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46afc76-faf0-4ddb-a00b-d1942c80a277 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:06.817341 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46afc76-faf0-4ddb-a00b-d1942c80a277 None admin] RBAC: Adding query filter params (name=member) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:06.817632 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46afc76-faf0-4ddb-a00b-d1942c80a277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:06.819059 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46afc76-faf0-4ddb-a00b-d1942c80a277 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:06.837219 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 137/263] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:05:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:06.848225 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46afc76-faf0-4ddb-a00b-d1942c80a277 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:06.858089 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:06.872232 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 127/264] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:06.878175 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8200ec4-2ee9-4ea3-a2c7-3931ad4c7f3b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:07.002673 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46afc76-faf0-4ddb-a00b-d1942c80a277 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:07.008685 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8200ec4-2ee9-4ea3-a2c7-3931ad4c7f3b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:07.045828 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bf361-4c19-4226-9a43-acaf1bd868c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:07.046850 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bf361-4c19-4226-9a43-acaf1bd868c1 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:07.047343 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bf361-4c19-4226-9a43-acaf1bd868c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:07.047834 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bf361-4c19-4226-9a43-acaf1bd868c1 None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:07.047937 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd236a0-2177-42c5-8028-8296c9319a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:07.048515 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd236a0-2177-42c5-8028-8296c9319a26 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:07.048788 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd236a0-2177-42c5-8028-8296c9319a26 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:07.049074 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd236a0-2177-42c5-8028-8296c9319a26 None admin] PATH_INFO: `/v3/users/c2441b13b85c4a459df640a938406157` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:07.049943 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bf361-4c19-4226-9a43-acaf1bd868c1 None admin] RBAC: Authorizing `identity:get_project(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:07.051604 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bf361-4c19-4226-9a43-acaf1bd868c1 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:07.053892 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 128/265] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:06 2022] GET /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:07.054482 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd236a0-2177-42c5-8028-8296c9319a26 None admin] RBAC: Authorizing `identity:get_user(user_id=c2441b13b85c4a459df640a938406157)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:07.055999 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd236a0-2177-42c5-8028-8296c9319a26 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:07.058150 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 138/266] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:05:06 2022] GET /identity/v3/users/c2441b13b85c4a459df640a938406157 => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:07.063026 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd236a0-2177-42c5-8028-8296c9319a26 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:07.063142 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bf361-4c19-4226-9a43-acaf1bd868c1 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:07.119040 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:07.126921 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:07.174109 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bf361-4c19-4226-9a43-acaf1bd868c1 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:07.210442 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c36a9-a330-41df-9868-b8278d44f48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:07.211450 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c36a9-a330-41df-9868-b8278d44f48c None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:07.211904 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c36a9-a330-41df-9868-b8278d44f48c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:07.212345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c36a9-a330-41df-9868-b8278d44f48c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:07.213235 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c36a9-a330-41df-9868-b8278d44f48c None admin] RBAC: Adding query filter params (role.id=877977a662dd49daab1ee42ba834153e, scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c, user.id=47f211be357548cd82d0a1ef361d8c16) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:07.213771 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c36a9-a330-41df-9868-b8278d44f48c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:07.215667 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c36a9-a330-41df-9868-b8278d44f48c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:07.222410 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 129/267] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:05:07 2022] GET /identity/v3/role_assignments?user.id=47f211be357548cd82d0a1ef361d8c16&scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c&role.id=877977a662dd49daab1ee42ba834153e => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:07.278051 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd236a0-2177-42c5-8028-8296c9319a26 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:07.320860 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4209a3d-1e4d-4991-ad1b-fb61f7a62c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:07.321879 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4209a3d-1e4d-4991-ad1b-fb61f7a62c88 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:07.322334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4209a3d-1e4d-4991-ad1b-fb61f7a62c88 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:07.322778 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4209a3d-1e4d-4991-ad1b-fb61f7a62c88 None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:07.325341 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4209a3d-1e4d-4991-ad1b-fb61f7a62c88 None admin] RBAC: Authorizing `identity:get_project(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:07.327089 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4209a3d-1e4d-4991-ad1b-fb61f7a62c88 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:07.329272 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 139/268] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:07 2022] GET /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:07.335221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c36a9-a330-41df-9868-b8278d44f48c None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:07.469724 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c36a9-a330-41df-9868-b8278d44f48c None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:07.491845 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:07.509874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded897fa-361c-44bd-924e-f13bf745eaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:07.510556 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded897fa-361c-44bd-924e-f13bf745eaba None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:07.510829 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded897fa-361c-44bd-924e-f13bf745eaba None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:07.511098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded897fa-361c-44bd-924e-f13bf745eaba None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c/users/c2441b13b85c4a459df640a938406157/roles/dfd00108a3dd42f1a9dd0335f4b8f508` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:07.513037 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded897fa-361c-44bd-924e-f13bf745eaba None admin] RBAC: Authorizing `identity:create_grant(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c, user_id=c2441b13b85c4a459df640a938406157, role_id=dfd00108a3dd42f1a9dd0335f4b8f508)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:07.514541 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded897fa-361c-44bd-924e-f13bf745eaba None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:07.531104 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 130/269] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 15:05:07 2022] PUT /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c/users/c2441b13b85c4a459df640a938406157/roles/dfd00108a3dd42f1a9dd0335f4b8f508 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:05:08.500784 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91e502-f2e1-4b3e-9b12-b64f1e88ce27 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:08.501312 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91e502-f2e1-4b3e-9b12-b64f1e88ce27 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:08.501312 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91e502-f2e1-4b3e-9b12-b64f1e88ce27 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:08.502967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 140/270] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:08.508216 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c34d1-fe2b-4b85-85b6-6e68615cfec9 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:08.508624 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c34d1-fe2b-4b85-85b6-6e68615cfec9 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:08.508856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c34d1-fe2b-4b85-85b6-6e68615cfec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:08.527213 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-108c34d1-fe2b-4b85-85b6-6e68615cfec9 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:08.528393 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-108c34d1-fe2b-4b85-85b6-6e68615cfec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:08.594718 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 131/271] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:08.601806 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e55d4-bc05-4a67-bfd2-903fcc14732d None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:08.602155 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e55d4-bc05-4a67-bfd2-903fcc14732d None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:08.602428 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e55d4-bc05-4a67-bfd2-903fcc14732d None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:08.604764 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 141/272] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:08.609440 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe3c13-8e48-4540-ab58-613e0c6af75e None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:08.609925 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe3c13-8e48-4540-ab58-613e0c6af75e None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:08.610356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe3c13-8e48-4540-ab58-613e0c6af75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:08.628720 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-41fe3c13-8e48-4540-ab58-613e0c6af75e None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:08.630159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-41fe3c13-8e48-4540-ab58-613e0c6af75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:08.701793 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 132/273] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:08.933560 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e55d4-bc05-4a67-bfd2-903fcc14732d None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:09.014767 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe3c13-8e48-4540-ab58-613e0c6af75e None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:09.024927 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:09.041113 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e55d4-bc05-4a67-bfd2-903fcc14732d None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:09.055827 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:09.077151 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef39ca-bfa5-4a12-bc17-1de4c5af8f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:09.077774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef39ca-bfa5-4a12-bc17-1de4c5af8f81 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:09.078054 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef39ca-bfa5-4a12-bc17-1de4c5af8f81 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:09.078324 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef39ca-bfa5-4a12-bc17-1de4c5af8f81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:09.089808 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef39ca-bfa5-4a12-bc17-1de4c5af8f81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:09.096596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-d6ef39ca-bfa5-4a12-bc17-1de4c5af8f81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:09.096596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:09.096596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:09.096596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:09.096596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:09.096596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:09.096596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:09.096596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:09.096596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:09.096596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:09.096596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:09.096596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:09.096596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:09.096596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:09.096596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:09.096596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:09.097468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:09.097468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:09.097468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:09.097468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:09.097468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:09.097468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:09.097468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:09.097468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:09.097468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:09.097468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:09.097468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:09.097468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:09.097468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:09.097468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:09.097468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:09.097468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:09.098596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:09.098596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:09.098596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:09.098596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:09.098596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:09.098596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:09.098596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:09.098596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:09.098596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:09.098596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:09.098596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:09.098596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:09.101827 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 142/274] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:09.104869 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef39ca-bfa5-4a12-bc17-1de4c5af8f81 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:09.128733 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe3c13-8e48-4540-ab58-613e0c6af75e None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:09.170818 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05964a-ca26-4830-a93c-c864e6e0cb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:09.171941 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05964a-ca26-4830-a93c-c864e6e0cb5f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:09.172269 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05964a-ca26-4830-a93c-c864e6e0cb5f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:09.172554 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05964a-ca26-4830-a93c-c864e6e0cb5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:09.174026 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05964a-ca26-4830-a93c-c864e6e0cb5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:09.176086 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05964a-ca26-4830-a93c-c864e6e0cb5f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:09.178216 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 133/275] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:09.183854 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05964a-ca26-4830-a93c-c864e6e0cb5f None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:09.233082 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef39ca-bfa5-4a12-bc17-1de4c5af8f81 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:09.276417 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0448ff-71a3-46e0-a482-50c3b227496c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:09.277895 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0448ff-71a3-46e0-a482-50c3b227496c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:09.278748 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0448ff-71a3-46e0-a482-50c3b227496c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:09.279469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0448ff-71a3-46e0-a482-50c3b227496c None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:09.280384 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0448ff-71a3-46e0-a482-50c3b227496c None admin] RBAC: Adding query filter params (name=member) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:09.281116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0448ff-71a3-46e0-a482-50c3b227496c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:09.282994 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0448ff-71a3-46e0-a482-50c3b227496c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:09.297296 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 143/276] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:05:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:09.298210 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0448ff-71a3-46e0-a482-50c3b227496c None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:09.305109 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05964a-ca26-4830-a93c-c864e6e0cb5f None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:09.309030 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:09.315264 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:09.344444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293ba0f-bc93-444c-b43c-04c0af8f126f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:09.345517 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293ba0f-bc93-444c-b43c-04c0af8f126f None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:09.346249 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293ba0f-bc93-444c-b43c-04c0af8f126f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:09.346733 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293ba0f-bc93-444c-b43c-04c0af8f126f None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:09.347565 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293ba0f-bc93-444c-b43c-04c0af8f126f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:09.349417 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293ba0f-bc93-444c-b43c-04c0af8f126f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:09.374084 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 134/277] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 15:05:09 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:05:09.375325 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f5798-7d5e-4fd5-a810-5b388c339ca3 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:09.375602 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f5798-7d5e-4fd5-a810-5b388c339ca3 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:09.375872 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f5798-7d5e-4fd5-a810-5b388c339ca3 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:09.377260 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 135/278] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:09.383201 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb473f86-1eb3-4d05-a7a1-5af48b7c7996 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:09.383632 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb473f86-1eb3-4d05-a7a1-5af48b7c7996 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:09.383791 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb473f86-1eb3-4d05-a7a1-5af48b7c7996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:09.408679 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-eb473f86-1eb3-4d05-a7a1-5af48b7c7996 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:09.410572 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-eb473f86-1eb3-4d05-a7a1-5af48b7c7996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:09.413343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0448ff-71a3-46e0-a482-50c3b227496c None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:09.449137 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c5b44-e411-401b-aee7-044aae57639e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:09.450163 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c5b44-e411-401b-aee7-044aae57639e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:09.450634 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c5b44-e411-401b-aee7-044aae57639e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:09.451109 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c5b44-e411-401b-aee7-044aae57639e None admin] PATH_INFO: `/v3/users/9c9ba5a519c1455f822d13b978dbde79` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:09.467183 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c5b44-e411-401b-aee7-044aae57639e None admin] RBAC: Authorizing `identity:get_user(user_id=9c9ba5a519c1455f822d13b978dbde79)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:09.468942 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c5b44-e411-401b-aee7-044aae57639e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:09.471271 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 144/279] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:05:09 2022] GET /identity/v3/users/9c9ba5a519c1455f822d13b978dbde79 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:09.476943 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c5b44-e411-401b-aee7-044aae57639e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:09.506428 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 136/280] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:09.568056 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:09.616703 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c5b44-e411-401b-aee7-044aae57639e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:09.653066 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42850121-be53-42a7-a13d-3812e82ba558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:09.653673 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42850121-be53-42a7-a13d-3812e82ba558 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:09.653988 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42850121-be53-42a7-a13d-3812e82ba558 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:09.654261 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42850121-be53-42a7-a13d-3812e82ba558 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:09.654972 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42850121-be53-42a7-a13d-3812e82ba558 None admin] RBAC: Adding query filter params (role.id=dfd00108a3dd42f1a9dd0335f4b8f508, user.id=9c9ba5a519c1455f822d13b978dbde79, scope.system=all) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:09.655272 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42850121-be53-42a7-a13d-3812e82ba558 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:09.656991 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42850121-be53-42a7-a13d-3812e82ba558 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:09.662611 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 145/281] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Sep 23 15:05:09 2022] GET /identity/v3/role_assignments?user.id=9c9ba5a519c1455f822d13b978dbde79&scope.system=all&role.id=dfd00108a3dd42f1a9dd0335f4b8f508 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:09.849920 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb473f86-1eb3-4d05-a7a1-5af48b7c7996 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:09.979740 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:09.993772 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb473f86-1eb3-4d05-a7a1-5af48b7c7996 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:10.041296 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd01f9-fe3f-421b-a838-b6280453c62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:10.042241 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd01f9-fe3f-421b-a838-b6280453c62e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:10.042513 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd01f9-fe3f-421b-a838-b6280453c62e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:10.042778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd01f9-fe3f-421b-a838-b6280453c62e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:10.054836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd01f9-fe3f-421b-a838-b6280453c62e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:10.059762 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-31cd01f9-fe3f-421b-a838-b6280453c62e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:05:10.059762 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:10.059762 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:10.059762 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:10.059762 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:10.059762 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:10.059762 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:10.059762 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:10.059762 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:10.059762 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:10.059762 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:10.059762 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:10.059762 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:10.059762 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:10.059762 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:10.059762 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:10.060630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:10.060630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:10.060630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:10.060630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:10.060630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:10.060630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:10.060630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:10.060630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:10.060630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:10.060630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:10.060630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:10.060630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:10.060630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:10.060630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:10.060630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:10.060630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:10.061434 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:10.061434 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:10.061434 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:10.061434 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:10.061434 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:10.061434 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:10.061434 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:10.061434 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:10.061434 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:10.061434 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:10.061434 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:05:10.061434 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:10.061434 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 137/282] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:10.065944 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb526b-7616-4b73-9216-72a44ed84234 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:10.066462 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb526b-7616-4b73-9216-72a44ed84234 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:10.066963 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb526b-7616-4b73-9216-72a44ed84234 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:10.068750 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 146/283] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:10.074029 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb526b-7616-4b73-9216-72a44ed84234 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:10.074155 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447bcad-e1a5-4d05-a315-21a24380f6b9 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:10.074371 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447bcad-e1a5-4d05-a315-21a24380f6b9 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:10.074649 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447bcad-e1a5-4d05-a315-21a24380f6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:10.102486 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-e447bcad-e1a5-4d05-a315-21a24380f6b9 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:10.103684 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-e447bcad-e1a5-4d05-a315-21a24380f6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:10.215243 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 138/284] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:05:10.275313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb526b-7616-4b73-9216-72a44ed84234 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:10.315914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:10.329942 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ca2d6-98d6-4936-9826-b208eb68cacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:10.330838 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ca2d6-98d6-4936-9826-b208eb68cacb None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:10.331245 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ca2d6-98d6-4936-9826-b208eb68cacb None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:10.331640 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ca2d6-98d6-4936-9826-b208eb68cacb None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:10.332629 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ca2d6-98d6-4936-9826-b208eb68cacb None admin] RBAC: Adding query filter params (name=reader) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:10.333078 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ca2d6-98d6-4936-9826-b208eb68cacb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:10.335262 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ca2d6-98d6-4936-9826-b208eb68cacb None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:10.352099 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 147/285] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:05:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:10.358687 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447bcad-e1a5-4d05-a315-21a24380f6b9 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:10.481169 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:10.502117 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447bcad-e1a5-4d05-a315-21a24380f6b9 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:10.536643 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a8117-c863-4dce-a6c5-0a45587c3a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:10.537213 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a8117-c863-4dce-a6c5-0a45587c3a2f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:10.537490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a8117-c863-4dce-a6c5-0a45587c3a2f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:10.537807 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a8117-c863-4dce-a6c5-0a45587c3a2f None admin] PATH_INFO: `/v3/users/e21aeced52f443ba89dc80fa7f19b1ef` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:10.538938 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a8117-c863-4dce-a6c5-0a45587c3a2f None admin] RBAC: Authorizing `identity:get_user(user_id=e21aeced52f443ba89dc80fa7f19b1ef)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:10.540429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a8117-c863-4dce-a6c5-0a45587c3a2f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:10.542347 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 139/286] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:05:10 2022] GET /identity/v3/users/e21aeced52f443ba89dc80fa7f19b1ef => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:10.547887 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ca2d6-98d6-4936-9826-b208eb68cacb None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:10.593564 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a8117-c863-4dce-a6c5-0a45587c3a2f None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:10.700137 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a8117-c863-4dce-a6c5-0a45587c3a2f None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:10.749042 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d033573-c6cc-4946-80bd-3876731b0fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:10.749949 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d033573-c6cc-4946-80bd-3876731b0fec None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:10.750369 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d033573-c6cc-4946-80bd-3876731b0fec None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:10.750807 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d033573-c6cc-4946-80bd-3876731b0fec None admin] PATH_INFO: `/v3/roles/member` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:10.761483 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d033573-c6cc-4946-80bd-3876731b0fec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:10.766985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-8d033573-c6cc-4946-80bd-3876731b0fec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:10.766985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:10.766985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:10.766985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:10.766985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:10.766985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:10.766985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:10.766985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:10.766985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:10.766985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:10.766985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:10.766985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:10.766985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:10.766985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:10.766985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:10.766985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:10.767879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:10.767879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:10.767879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:10.767879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:10.767879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:10.767879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:10.767879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:10.767879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:10.767879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:10.767879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:10.767879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:10.767879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:10.767879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:10.767879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:10.767879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:10.767879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:10.768708 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:10.768708 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:10.768708 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:10.768708 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:10.768708 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:10.768708 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:10.768708 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:10.768708 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:10.768708 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:10.768708 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:10.768708 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:10.768708 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:10.770966 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 140/287] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:05:10.778746 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d033573-c6cc-4946-80bd-3876731b0fec None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:10.780859 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ca2d6-98d6-4936-9826-b208eb68cacb None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:10.799758 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:10.822548 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53de9fa-af71-4db3-8e4a-d971fc2adf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:10.823326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53de9fa-af71-4db3-8e4a-d971fc2adf81 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:10.824115 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53de9fa-af71-4db3-8e4a-d971fc2adf81 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:10.824482 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53de9fa-af71-4db3-8e4a-d971fc2adf81 None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:10.825795 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53de9fa-af71-4db3-8e4a-d971fc2adf81 None admin] RBAC: Authorizing `identity:get_project(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:10.827881 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53de9fa-af71-4db3-8e4a-d971fc2adf81 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:10.830023 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 148/288] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:10 2022] GET /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:10.836774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53de9fa-af71-4db3-8e4a-d971fc2adf81 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:10.955237 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:10.970760 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d033573-c6cc-4946-80bd-3876731b0fec None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:11.023070 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c463c-e4c4-4560-b3ab-ec7efc0fbf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:11.023704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c463c-e4c4-4560-b3ab-ec7efc0fbf8e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:11.024058 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c463c-e4c4-4560-b3ab-ec7efc0fbf8e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:11.024332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c463c-e4c4-4560-b3ab-ec7efc0fbf8e None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:11.025002 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c463c-e4c4-4560-b3ab-ec7efc0fbf8e None admin] RBAC: Adding query filter params (name=member) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:11.025301 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c463c-e4c4-4560-b3ab-ec7efc0fbf8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:11.026765 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c463c-e4c4-4560-b3ab-ec7efc0fbf8e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:11.039298 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53de9fa-af71-4db3-8e4a-d971fc2adf81 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:11.042048 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 141/289] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:05:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:11.047484 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c463c-e4c4-4560-b3ab-ec7efc0fbf8e None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:11.087034 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbecd8-227f-474d-a8a3-a98b2e5e0472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:11.087712 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbecd8-227f-474d-a8a3-a98b2e5e0472 None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:11.087987 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbecd8-227f-474d-a8a3-a98b2e5e0472 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:11.088258 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbecd8-227f-474d-a8a3-a98b2e5e0472 None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c/users/e21aeced52f443ba89dc80fa7f19b1ef/roles/c3cc9c287a1d45e9ad18d3ce7b9975cb` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:11.090194 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbecd8-227f-474d-a8a3-a98b2e5e0472 None admin] RBAC: Authorizing `identity:create_grant(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c, user_id=e21aeced52f443ba89dc80fa7f19b1ef, role_id=c3cc9c287a1d45e9ad18d3ce7b9975cb)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:11.091647 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbecd8-227f-474d-a8a3-a98b2e5e0472 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:11.129743 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 149/290] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 15:05:10 2022] PUT /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c/users/e21aeced52f443ba89dc80fa7f19b1ef/roles/c3cc9c287a1d45e9ad18d3ce7b9975cb => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:05:11.149145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:11.197487 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c463c-e4c4-4560-b3ab-ec7efc0fbf8e None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:11.256626 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376803d3-0b31-4c75-aa7a-818abe55fc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:11.257284 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376803d3-0b31-4c75-aa7a-818abe55fc7c None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:11.257556 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376803d3-0b31-4c75-aa7a-818abe55fc7c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:11.257851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376803d3-0b31-4c75-aa7a-818abe55fc7c None admin] PATH_INFO: `/v3/users/c2441b13b85c4a459df640a938406157` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:11.259086 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376803d3-0b31-4c75-aa7a-818abe55fc7c None admin] RBAC: Authorizing `identity:get_user(user_id=c2441b13b85c4a459df640a938406157)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:11.260549 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376803d3-0b31-4c75-aa7a-818abe55fc7c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:11.262509 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 142/291] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:05:11 2022] GET /identity/v3/users/c2441b13b85c4a459df640a938406157 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:11.268041 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbecd8-227f-474d-a8a3-a98b2e5e0472 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:11.400727 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbecd8-227f-474d-a8a3-a98b2e5e0472 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:11.424043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:11.440934 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f726117-0dde-40d1-9956-d9190ea3214c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:11.441551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f726117-0dde-40d1-9956-d9190ea3214c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:11.441875 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f726117-0dde-40d1-9956-d9190ea3214c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:11.442148 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f726117-0dde-40d1-9956-d9190ea3214c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:11.534682 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f726117-0dde-40d1-9956-d9190ea3214c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:11.536164 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f726117-0dde-40d1-9956-d9190ea3214c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:11.640228 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 150/292] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:11.650839 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376803d3-0b31-4c75-aa7a-818abe55fc7c None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:11.822515 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376803d3-0b31-4c75-aa7a-818abe55fc7c None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:11.876393 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4a1ac-3a7a-4a74-8e39-66933bab3c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:11.877057 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4a1ac-3a7a-4a74-8e39-66933bab3c0f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:11.877332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4a1ac-3a7a-4a74-8e39-66933bab3c0f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:11.877599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4a1ac-3a7a-4a74-8e39-66933bab3c0f None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:11.878812 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4a1ac-3a7a-4a74-8e39-66933bab3c0f None admin] RBAC: Authorizing `identity:get_project(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:11.880288 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4a1ac-3a7a-4a74-8e39-66933bab3c0f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:11.882080 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 143/293] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:11 2022] GET /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:11.888431 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f726117-0dde-40d1-9956-d9190ea3214c None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:11.929764 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:12.052921 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f726117-0dde-40d1-9956-d9190ea3214c None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:12.104201 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c888f8-6e2f-41e0-a695-2c965f1c4001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:12.104832 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c888f8-6e2f-41e0-a695-2c965f1c4001 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:12.105102 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c888f8-6e2f-41e0-a695-2c965f1c4001 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:12.105367 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c888f8-6e2f-41e0-a695-2c965f1c4001 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:12.106130 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c888f8-6e2f-41e0-a695-2c965f1c4001 None admin] RBAC: Adding query filter params (role.id=dfd00108a3dd42f1a9dd0335f4b8f508, scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c, user.id=c2441b13b85c4a459df640a938406157) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:12.106739 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c888f8-6e2f-41e0-a695-2c965f1c4001 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:12.108222 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c888f8-6e2f-41e0-a695-2c965f1c4001 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:12.118924 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 151/294] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:05:11 2022] GET /identity/v3/role_assignments?user.id=c2441b13b85c4a459df640a938406157&scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c&role.id=dfd00108a3dd42f1a9dd0335f4b8f508 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:12.406569 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7db983-bb44-43d3-9a1c-c0daea9c19db None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:12.407115 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7db983-bb44-43d3-9a1c-c0daea9c19db None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:12.407115 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7db983-bb44-43d3-9a1c-c0daea9c19db None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:12.408655 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 144/295] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:12.414132 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe0f99-d832-4d52-a27e-91a7ceb2e838 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:12.414443 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe0f99-d832-4d52-a27e-91a7ceb2e838 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:12.414746 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe0f99-d832-4d52-a27e-91a7ceb2e838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:12.435271 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-72fe0f99-d832-4d52-a27e-91a7ceb2e838 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:12.436459 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-72fe0f99-d832-4d52-a27e-91a7ceb2e838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:12.513215 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 152/296] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:05:12.667902 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d637b-b6e5-42ea-a9d4-16aff7fb3f97 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:12.667902 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d637b-b6e5-42ea-a9d4-16aff7fb3f97 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:12.667902 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d637b-b6e5-42ea-a9d4-16aff7fb3f97 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:12.667902 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 145/297] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:12.673734 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651abf7a-fb42-4155-a3f7-074ad46600e7 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:12.674287 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651abf7a-fb42-4155-a3f7-074ad46600e7 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:12.674751 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651abf7a-fb42-4155-a3f7-074ad46600e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:12.695316 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-651abf7a-fb42-4155-a3f7-074ad46600e7 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:12.696874 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-651abf7a-fb42-4155-a3f7-074ad46600e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:12.709289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:12.760866 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38279e-17ad-455d-978f-2d77b587aabd None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:12.761509 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38279e-17ad-455d-978f-2d77b587aabd None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:12.762011 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38279e-17ad-455d-978f-2d77b587aabd None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:12.763586 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 146/298] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:05:12.769582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9e868-25e6-4bb0-a79c-b446554df4d1 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:12.770108 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9e868-25e6-4bb0-a79c-b446554df4d1 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:12.770566 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9e868-25e6-4bb0-a79c-b446554df4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:12.782141 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 153/299] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:12.796249 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-5bd9e868-25e6-4bb0-a79c-b446554df4d1 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:12.798300 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-5bd9e868-25e6-4bb0-a79c-b446554df4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:12.814041 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:12.876000 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651abf7a-fb42-4155-a3f7-074ad46600e7 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:12.877679 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 147/300] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:12.977303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651abf7a-fb42-4155-a3f7-074ad46600e7 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:13.011332 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab1a42-ec59-4665-b817-d7093968fafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:13.011969 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab1a42-ec59-4665-b817-d7093968fafd None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:13.012245 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab1a42-ec59-4665-b817-d7093968fafd None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:13.012511 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab1a42-ec59-4665-b817-d7093968fafd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:13.022625 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab1a42-ec59-4665-b817-d7093968fafd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:13.027475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-efab1a42-ec59-4665-b817-d7093968fafd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:05:13.027475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:13.027475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:13.027475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:13.027475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:13.027475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:13.027475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:13.027475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:13.027475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:13.027475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:13.027475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:13.027475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:13.027475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:13.027475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:13.027475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:13.027475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:13.028358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:13.028358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:13.028358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:13.028358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:13.028358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:13.028358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:13.028358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:13.028358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:13.028358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:13.028358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:13.028358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:13.028358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:13.028358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:13.028358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:13.028358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:13.028358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:13.029723 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:13.029723 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:13.029723 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:13.029723 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:13.029723 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:13.029723 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:13.029723 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:13.029723 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:13.029723 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:13.029723 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:13.029723 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:05:13.029723 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:13.029723 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 154/301] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:05:13.034785 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9e868-25e6-4bb0-a79c-b446554df4d1 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:13.135895 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab1a42-ec59-4665-b817-d7093968fafd None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:13.138090 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9e868-25e6-4bb0-a79c-b446554df4d1 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:13.140228 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:13.182299 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff1196-4d6d-4bbb-b395-096bcdd11697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:13.182923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff1196-4d6d-4bbb-b395-096bcdd11697 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:13.183226 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff1196-4d6d-4bbb-b395-096bcdd11697 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:13.183472 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff1196-4d6d-4bbb-b395-096bcdd11697 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:13.184125 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff1196-4d6d-4bbb-b395-096bcdd11697 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:13.184427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff1196-4d6d-4bbb-b395-096bcdd11697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:13.186770 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff1196-4d6d-4bbb-b395-096bcdd11697 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:13.193812 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:13.198905 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 148/302] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:05:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:13.204498 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff1196-4d6d-4bbb-b395-096bcdd11697 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:13.252025 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab1a42-ec59-4665-b817-d7093968fafd None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:13.288451 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cbb14-ce90-41b4-9051-60aa5fd107c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:13.289195 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cbb14-ce90-41b4-9051-60aa5fd107c4 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:13.289503 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cbb14-ce90-41b4-9051-60aa5fd107c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:13.289920 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cbb14-ce90-41b4-9051-60aa5fd107c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:13.300544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cbb14-ce90-41b4-9051-60aa5fd107c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:13.306077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-540cbb14-ce90-41b4-9051-60aa5fd107c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:13.306077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:13.306077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:13.306077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:13.306077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:13.306077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:13.306077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:13.306077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:13.306077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:13.306077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:13.306077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:13.306077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:13.306077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:13.306077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:13.306077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:13.306077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:13.306966 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:13.306966 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:13.306966 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:13.306966 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:13.306966 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:13.306966 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:13.306966 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:13.306966 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:13.306966 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:13.306966 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:13.306966 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:13.306966 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:13.306966 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:13.306966 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:13.306966 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:13.306966 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:13.310569 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:13.310569 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:13.310569 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:13.310569 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:13.310569 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:13.310569 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:13.310569 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:13.310569 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:13.310569 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:13.310569 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:13.310569 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:13.310569 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:13.311256 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff1196-4d6d-4bbb-b395-096bcdd11697 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:13.311329 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 155/303] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:05:13.311329 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cbb14-ce90-41b4-9051-60aa5fd107c4 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:13.345062 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7e64f-49ad-4eae-aa6b-2a4c00607674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:13.345702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7e64f-49ad-4eae-aa6b-2a4c00607674 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:13.346005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7e64f-49ad-4eae-aa6b-2a4c00607674 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:13.346272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7e64f-49ad-4eae-aa6b-2a4c00607674 None admin] PATH_INFO: `/v3/users/fa19efaf2f8147698db5184c12096241` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:13.360097 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7e64f-49ad-4eae-aa6b-2a4c00607674 None admin] RBAC: Authorizing `identity:get_user(user_id=fa19efaf2f8147698db5184c12096241)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:13.361555 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7e64f-49ad-4eae-aa6b-2a4c00607674 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:13.363219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 149/304] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:05:13 2022] GET /identity/v3/users/fa19efaf2f8147698db5184c12096241 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:13.363971 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7e64f-49ad-4eae-aa6b-2a4c00607674 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:13.378571 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:13.417975 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cbb14-ce90-41b4-9051-60aa5fd107c4 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:13.428086 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:13.454560 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ea96b-5164-4b41-8bef-cf44a99648e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:13.455276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ea96b-5164-4b41-8bef-cf44a99648e9 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:13.455554 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ea96b-5164-4b41-8bef-cf44a99648e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:13.455825 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ea96b-5164-4b41-8bef-cf44a99648e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:13.456987 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ea96b-5164-4b41-8bef-cf44a99648e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:13.458518 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ea96b-5164-4b41-8bef-cf44a99648e9 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:13.460148 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 156/305] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:13.460940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ea96b-5164-4b41-8bef-cf44a99648e9 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:13.483557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7e64f-49ad-4eae-aa6b-2a4c00607674 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:13.518516 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e97e5-1503-446b-a7e9-74037d64da5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:13.519446 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e97e5-1503-446b-a7e9-74037d64da5b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:13.519922 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e97e5-1503-446b-a7e9-74037d64da5b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:13.520363 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e97e5-1503-446b-a7e9-74037d64da5b None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:13.521193 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e97e5-1503-446b-a7e9-74037d64da5b None admin] RBAC: Adding query filter params (name=member) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:13.521665 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e97e5-1503-446b-a7e9-74037d64da5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:13.523278 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e97e5-1503-446b-a7e9-74037d64da5b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:13.532978 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 150/306] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:05:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:13.538502 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e97e5-1503-446b-a7e9-74037d64da5b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:13.564708 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ea96b-5164-4b41-8bef-cf44a99648e9 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:13.595902 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:13.601715 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deec982-b907-4ca8-b511-ff2c0bb03064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:13.602779 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deec982-b907-4ca8-b511-ff2c0bb03064 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:13.603535 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deec982-b907-4ca8-b511-ff2c0bb03064 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:13.603846 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deec982-b907-4ca8-b511-ff2c0bb03064 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:13.604564 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deec982-b907-4ca8-b511-ff2c0bb03064 None admin] RBAC: Adding query filter params (role.id=c3cc9c287a1d45e9ad18d3ce7b9975cb, user.id=fa19efaf2f8147698db5184c12096241, scope.system=all) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:13.604871 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deec982-b907-4ca8-b511-ff2c0bb03064 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:13.606331 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deec982-b907-4ca8-b511-ff2c0bb03064 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:13.611916 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 157/307] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Sep 23 15:05:13 2022] GET /identity/v3/role_assignments?user.id=fa19efaf2f8147698db5184c12096241&scope.system=all&role.id=c3cc9c287a1d45e9ad18d3ce7b9975cb => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:13.612574 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deec982-b907-4ca8-b511-ff2c0bb03064 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:13.660962 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e97e5-1503-446b-a7e9-74037d64da5b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:13.692848 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:13.714099 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93342b4-f903-481b-a562-83ebaaa9e2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:13.715135 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93342b4-f903-481b-a562-83ebaaa9e2cc None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:13.715610 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93342b4-f903-481b-a562-83ebaaa9e2cc None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:13.716093 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93342b4-f903-481b-a562-83ebaaa9e2cc None admin] PATH_INFO: `/v3/groups` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:13.716923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93342b4-f903-481b-a562-83ebaaa9e2cc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:13.718756 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93342b4-f903-481b-a562-83ebaaa9e2cc None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:13.742895 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 151/308] 10.222.0.48 () {60 vars in 1134 bytes} [Fri Sep 23 15:05:13 2022] POST /identity/v3/groups => generated 229 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:05:13.743662 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deec982-b907-4ca8-b511-ff2c0bb03064 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:13.792925 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340f67f-73f5-4ee6-b0a7-ed1cc7aec3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:13.793501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340f67f-73f5-4ee6-b0a7-ed1cc7aec3cd None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:13.793867 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340f67f-73f5-4ee6-b0a7-ed1cc7aec3cd None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:13.794194 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340f67f-73f5-4ee6-b0a7-ed1cc7aec3cd None admin] PATH_INFO: `/v3/users/9c9ba5a519c1455f822d13b978dbde79` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:13.795466 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340f67f-73f5-4ee6-b0a7-ed1cc7aec3cd None admin] RBAC: Authorizing `identity:get_user(user_id=9c9ba5a519c1455f822d13b978dbde79)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:13.797018 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340f67f-73f5-4ee6-b0a7-ed1cc7aec3cd None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:13.799110 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 158/309] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:05:13 2022] GET /identity/v3/users/9c9ba5a519c1455f822d13b978dbde79 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:13.805004 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93342b4-f903-481b-a562-83ebaaa9e2cc None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:13.877869 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abf7a2-3528-4e53-a022-b28d20559fb3 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:13.878194 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abf7a2-3528-4e53-a022-b28d20559fb3 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:13.878420 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abf7a2-3528-4e53-a022-b28d20559fb3 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:13.880861 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 159/310] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:13.886060 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a283c9-0fbc-4d1a-b657-54cb4633c1bf None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:13.886702 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a283c9-0fbc-4d1a-b657-54cb4633c1bf None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:13.887041 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a283c9-0fbc-4d1a-b657-54cb4633c1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:13.912280 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-25a283c9-0fbc-4d1a-b657-54cb4633c1bf None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:13.913839 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-25a283c9-0fbc-4d1a-b657-54cb4633c1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:13.931053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93342b4-f903-481b-a562-83ebaaa9e2cc None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:13.979763 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0e887-bd6c-4fcf-a8cf-b8f3c08d7849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:13.980431 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0e887-bd6c-4fcf-a8cf-b8f3c08d7849 None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:13.980711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0e887-bd6c-4fcf-a8cf-b8f3c08d7849 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:13.980985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0e887-bd6c-4fcf-a8cf-b8f3c08d7849 None admin] PATH_INFO: `/v3/system/users/9c9ba5a519c1455f822d13b978dbde79/roles/dfd00108a3dd42f1a9dd0335f4b8f508` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:13.983715 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0e887-bd6c-4fcf-a8cf-b8f3c08d7849 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9c9ba5a519c1455f822d13b978dbde79, role_id=dfd00108a3dd42f1a9dd0335f4b8f508)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:13.985097 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0e887-bd6c-4fcf-a8cf-b8f3c08d7849 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:13.997932 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:14.000812 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 152/311] 10.222.0.48 () {58 vars in 1334 bytes} [Fri Sep 23 15:05:13 2022] PUT /identity/v3/system/users/9c9ba5a519c1455f822d13b978dbde79/roles/dfd00108a3dd42f1a9dd0335f4b8f508 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:05:14.013522 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 160/312] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:05:14.331645 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0e887-bd6c-4fcf-a8cf-b8f3c08d7849 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:14.379262 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:14.439885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0e887-bd6c-4fcf-a8cf-b8f3c08d7849 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:14.474228 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e21573-1796-42a1-ba6a-4aff76ab35b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:14.474865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e21573-1796-42a1-ba6a-4aff76ab35b1 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:14.475144 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e21573-1796-42a1-ba6a-4aff76ab35b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:14.475417 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e21573-1796-42a1-ba6a-4aff76ab35b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:14.486138 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e21573-1796-42a1-ba6a-4aff76ab35b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:14.491451 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-44e21573-1796-42a1-ba6a-4aff76ab35b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:05:14.491451 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:14.491451 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:14.491451 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:14.491451 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:14.491451 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:14.491451 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:14.491451 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:14.491451 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:14.491451 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:14.491451 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:14.491451 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:14.491451 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:14.491451 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:14.491451 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:14.491451 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:14.492322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:14.492322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:14.492322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:14.492322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:14.492322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:14.492322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:14.492322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:14.492322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:14.492322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:14.492322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:14.492322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:14.492322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:14.492322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:14.492322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:14.492322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:14.492322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:14.493187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:14.493187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:14.493187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:14.493187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:14.493187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:14.493187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:14.493187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:14.493187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:14.493187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:14.493187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:14.493187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:05:14.493187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:14.493187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 153/313] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:14.499872 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a283c9-0fbc-4d1a-b657-54cb4633c1bf None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:14.601165 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a283c9-0fbc-4d1a-b657-54cb4633c1bf None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:14.635071 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6b6aa-c2ee-417d-a5b5-637489f7315b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:14.636029 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6b6aa-c2ee-417d-a5b5-637489f7315b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:14.636513 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6b6aa-c2ee-417d-a5b5-637489f7315b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:14.636965 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6b6aa-c2ee-417d-a5b5-637489f7315b None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:14.637840 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6b6aa-c2ee-417d-a5b5-637489f7315b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:14.638323 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6b6aa-c2ee-417d-a5b5-637489f7315b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:14.639964 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6b6aa-c2ee-417d-a5b5-637489f7315b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:14.648483 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 161/314] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:05:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:14.654985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e21573-1796-42a1-ba6a-4aff76ab35b1 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:14.768804 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e21573-1796-42a1-ba6a-4aff76ab35b1 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:14.771177 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:14.804345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affb65f-ef68-447c-b71c-a37467c761c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:14.804987 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affb65f-ef68-447c-b71c-a37467c761c8 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:14.805363 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affb65f-ef68-447c-b71c-a37467c761c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:14.805637 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affb65f-ef68-447c-b71c-a37467c761c8 None admin] PATH_INFO: `/v3/users/e21aeced52f443ba89dc80fa7f19b1ef` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:14.807330 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affb65f-ef68-447c-b71c-a37467c761c8 None admin] RBAC: Authorizing `identity:get_user(user_id=e21aeced52f443ba89dc80fa7f19b1ef)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:14.808798 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affb65f-ef68-447c-b71c-a37467c761c8 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:14.815067 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 154/315] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:05:14 2022] GET /identity/v3/users/e21aeced52f443ba89dc80fa7f19b1ef => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:14.816415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6b6aa-c2ee-417d-a5b5-637489f7315b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:14.873717 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:14.920535 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6b6aa-c2ee-417d-a5b5-637489f7315b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:14.956380 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be2194-345b-4d28-a8a7-4d2e6bb2706c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:14.957373 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be2194-345b-4d28-a8a7-4d2e6bb2706c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:14.957871 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be2194-345b-4d28-a8a7-4d2e6bb2706c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:14.958323 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be2194-345b-4d28-a8a7-4d2e6bb2706c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:15.025338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be2194-345b-4d28-a8a7-4d2e6bb2706c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:15.027575 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be2194-345b-4d28-a8a7-4d2e6bb2706c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:15.087963 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:15.129235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 162/316] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:15.134976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affb65f-ef68-447c-b71c-a37467c761c8 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:15.247842 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affb65f-ef68-447c-b71c-a37467c761c8 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:15.283392 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156007b-8fbe-4ac0-acb1-fa0af55c791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:15.284030 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156007b-8fbe-4ac0-acb1-fa0af55c791e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:15.284336 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156007b-8fbe-4ac0-acb1-fa0af55c791e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:15.284617 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156007b-8fbe-4ac0-acb1-fa0af55c791e None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:15.285773 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156007b-8fbe-4ac0-acb1-fa0af55c791e None admin] RBAC: Authorizing `identity:get_project(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:15.287231 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156007b-8fbe-4ac0-acb1-fa0af55c791e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:15.289262 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 155/317] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:15 2022] GET /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:15.295077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be2194-345b-4d28-a8a7-4d2e6bb2706c None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:15.393012 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be2194-345b-4d28-a8a7-4d2e6bb2706c None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:15.427160 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04fa2b-8b4b-4d37-8434-44d426cd0557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:15.427770 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04fa2b-8b4b-4d37-8434-44d426cd0557 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:15.428045 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04fa2b-8b4b-4d37-8434-44d426cd0557 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:15.428314 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04fa2b-8b4b-4d37-8434-44d426cd0557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:15.429024 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04fa2b-8b4b-4d37-8434-44d426cd0557 None admin] RBAC: Adding query filter params (role.id=c3cc9c287a1d45e9ad18d3ce7b9975cb, scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c, user.id=e21aeced52f443ba89dc80fa7f19b1ef) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:15.429328 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04fa2b-8b4b-4d37-8434-44d426cd0557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:15.430837 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04fa2b-8b4b-4d37-8434-44d426cd0557 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:15.441847 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 163/318] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:05:15 2022] GET /identity/v3/role_assignments?user.id=e21aeced52f443ba89dc80fa7f19b1ef&scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c&role.id=c3cc9c287a1d45e9ad18d3ce7b9975cb => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:16.063593 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792079b4-70a3-4264-90ff-f389934496cd None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:16.064142 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792079b4-70a3-4264-90ff-f389934496cd None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:16.064142 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792079b4-70a3-4264-90ff-f389934496cd None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:16.065522 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 156/319] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:16.071533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ac2b3-0ca6-4b26-b898-a438b20fb5d3 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:16.072049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ac2b3-0ca6-4b26-b898-a438b20fb5d3 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:16.072049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ac2b3-0ca6-4b26-b898-a438b20fb5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:16.092038 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-8e0ac2b3-0ca6-4b26-b898-a438b20fb5d3 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:16.093265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-8e0ac2b3-0ca6-4b26-b898-a438b20fb5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:16.109860 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:16.166680 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 164/320] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:16.281206 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93174e52-6397-4848-8588-1610fb4ba763 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:16.281524 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93174e52-6397-4848-8588-1610fb4ba763 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:16.281786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93174e52-6397-4848-8588-1610fb4ba763 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:16.283177 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 157/321] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:16.288632 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb65ca-fca1-4be1-9651-b81daf52604f None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:16.288946 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb65ca-fca1-4be1-9651-b81daf52604f None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:16.289215 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb65ca-fca1-4be1-9651-b81daf52604f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:16.308307 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-f2bb65ca-fca1-4be1-9651-b81daf52604f None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:16.309810 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-f2bb65ca-fca1-4be1-9651-b81daf52604f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:16.385869 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 165/322] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:16.479334 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93174e52-6397-4848-8588-1610fb4ba763 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:16.480725 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015a67d-97f7-410e-9dce-982fb7dc1176 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:16.481211 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015a67d-97f7-410e-9dce-982fb7dc1176 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:16.482036 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015a67d-97f7-410e-9dce-982fb7dc1176 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:16.484997 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 166/323] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:05:16.490005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fd735-8d6d-4637-9663-b1c57a70da87 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:16.490243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fd735-8d6d-4637-9663-b1c57a70da87 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:16.490540 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fd735-8d6d-4637-9663-b1c57a70da87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:16.508073 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-914fd735-8d6d-4637-9663-b1c57a70da87 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:16.509285 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-914fd735-8d6d-4637-9663-b1c57a70da87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:16.526590 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:16.577282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 167/324] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:05:16.592554 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93174e52-6397-4848-8588-1610fb4ba763 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:16.634509 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1b3b8-1646-4702-900f-da9e5107a911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:16.635138 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1b3b8-1646-4702-900f-da9e5107a911 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:16.635411 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1b3b8-1646-4702-900f-da9e5107a911 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:16.635666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1b3b8-1646-4702-900f-da9e5107a911 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:16.645833 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1b3b8-1646-4702-900f-da9e5107a911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:16.650595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-cee1b3b8-1646-4702-900f-da9e5107a911 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:05:16.650595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:16.650595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:16.650595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:16.650595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:16.650595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:16.650595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:16.650595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:16.650595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:16.650595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:16.650595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:16.650595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:16.650595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:16.650595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:16.650595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:16.650595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:16.651523 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:16.651523 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:16.651523 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:16.651523 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:16.651523 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:16.651523 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:16.651523 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:16.651523 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:16.651523 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:16.651523 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:16.651523 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:16.651523 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:16.651523 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:16.651523 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:16.651523 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:16.651523 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:16.652345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:16.652345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:16.652345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:16.652345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:16.652345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:16.652345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:16.652345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:16.652345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:16.652345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:16.652345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:16.652345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:05:16.652345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:16.653622 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 158/325] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:16.657674 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fd735-8d6d-4637-9663-b1c57a70da87 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:16.670844 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:16.705398 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1b3b8-1646-4702-900f-da9e5107a911 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:16.766354 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fd735-8d6d-4637-9663-b1c57a70da87 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:16.803115 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42716e9f-9597-41ab-a729-f7ebf833be19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:16.803722 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42716e9f-9597-41ab-a729-f7ebf833be19 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:16.803998 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42716e9f-9597-41ab-a729-f7ebf833be19 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:16.804262 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42716e9f-9597-41ab-a729-f7ebf833be19 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:16.804915 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42716e9f-9597-41ab-a729-f7ebf833be19 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:16.805249 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42716e9f-9597-41ab-a729-f7ebf833be19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:16.806681 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42716e9f-9597-41ab-a729-f7ebf833be19 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:16.815682 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 168/326] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:05:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:16.820243 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:16.823058 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42716e9f-9597-41ab-a729-f7ebf833be19 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:16.823768 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1b3b8-1646-4702-900f-da9e5107a911 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:16.864070 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687b552-b60a-48df-a364-2c114652f8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:16.865071 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687b552-b60a-48df-a364-2c114652f8c9 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:16.865346 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687b552-b60a-48df-a364-2c114652f8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:16.865610 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687b552-b60a-48df-a364-2c114652f8c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:16.866934 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687b552-b60a-48df-a364-2c114652f8c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:16.868647 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687b552-b60a-48df-a364-2c114652f8c9 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:16.870456 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 159/327] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:16.876817 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687b552-b60a-48df-a364-2c114652f8c9 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:16.893304 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:16.922706 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42716e9f-9597-41ab-a729-f7ebf833be19 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:16.954345 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ea955-5798-4cda-8af8-d7c43d42cf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:16.954985 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ea955-5798-4cda-8af8-d7c43d42cf2b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:16.955260 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ea955-5798-4cda-8af8-d7c43d42cf2b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:16.955533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ea955-5798-4cda-8af8-d7c43d42cf2b None admin] PATH_INFO: `/v3/users/fa19efaf2f8147698db5184c12096241` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:16.956636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ea955-5798-4cda-8af8-d7c43d42cf2b None admin] RBAC: Authorizing `identity:get_user(user_id=fa19efaf2f8147698db5184c12096241)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:16.958120 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ea955-5798-4cda-8af8-d7c43d42cf2b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:16.959692 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 169/328] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:05:16 2022] GET /identity/v3/users/fa19efaf2f8147698db5184c12096241 => generated 293 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:16.960436 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ea955-5798-4cda-8af8-d7c43d42cf2b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:16.979914 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687b552-b60a-48df-a364-2c114652f8c9 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:17.013561 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e33d9-b391-4d18-b7aa-0c4238f7463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:17.014201 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e33d9-b391-4d18-b7aa-0c4238f7463d None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:17.014482 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e33d9-b391-4d18-b7aa-0c4238f7463d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:17.014751 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e33d9-b391-4d18-b7aa-0c4238f7463d None admin] PATH_INFO: `/v3/groups` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:17.015373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e33d9-b391-4d18-b7aa-0c4238f7463d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:17.016825 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e33d9-b391-4d18-b7aa-0c4238f7463d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:17.032057 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 160/329] 10.222.0.48 () {60 vars in 1134 bytes} [Fri Sep 23 15:05:16 2022] POST /identity/v3/groups => generated 226 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:05:17.032835 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e33d9-b391-4d18-b7aa-0c4238f7463d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:17.058908 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ea955-5798-4cda-8af8-d7c43d42cf2b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:17.090470 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:17.097594 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407348c-4373-45f9-bcef-e19bf2878613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:17.098564 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407348c-4373-45f9-bcef-e19bf2878613 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:17.098845 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407348c-4373-45f9-bcef-e19bf2878613 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:17.099114 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407348c-4373-45f9-bcef-e19bf2878613 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:17.108840 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:17.113555 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407348c-4373-45f9-bcef-e19bf2878613 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:17.118791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-d407348c-4373-45f9-bcef-e19bf2878613 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:17.118791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:17.118791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:17.118791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:17.118791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:17.118791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:17.118791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:17.118791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:17.118791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:17.118791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:17.118791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:17.118791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:17.118791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:17.118791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:17.118791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:17.118791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:17.119741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:17.119741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:17.119741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:17.119741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:17.119741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:17.119741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:17.119741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:17.119741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:17.119741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:17.119741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:17.119741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:17.119741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:17.119741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:17.119741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:17.119741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:17.119741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:17.123229 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:17.123229 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:17.123229 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:17.123229 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:17.123229 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:17.123229 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:17.123229 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:17.123229 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:17.123229 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:17.123229 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:17.123229 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:17.123229 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:17.123229 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 170/330] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:17.126001 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407348c-4373-45f9-bcef-e19bf2878613 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:17.175718 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e33d9-b391-4d18-b7aa-0c4238f7463d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:17.212690 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20d1a0-323a-4b16-80c7-0f6a04ffe253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:17.213368 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20d1a0-323a-4b16-80c7-0f6a04ffe253 None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:17.213649 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20d1a0-323a-4b16-80c7-0f6a04ffe253 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:17.213964 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20d1a0-323a-4b16-80c7-0f6a04ffe253 None admin] PATH_INFO: `/v3/system/users/fa19efaf2f8147698db5184c12096241/roles/c3cc9c287a1d45e9ad18d3ce7b9975cb` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:17.215482 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20d1a0-323a-4b16-80c7-0f6a04ffe253 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fa19efaf2f8147698db5184c12096241, role_id=c3cc9c287a1d45e9ad18d3ce7b9975cb)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:17.216880 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20d1a0-323a-4b16-80c7-0f6a04ffe253 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:17.226051 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 161/331] 10.222.0.48 () {58 vars in 1334 bytes} [Fri Sep 23 15:05:17 2022] PUT /identity/v3/system/users/fa19efaf2f8147698db5184c12096241/roles/c3cc9c287a1d45e9ad18d3ce7b9975cb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:05:17.238455 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407348c-4373-45f9-bcef-e19bf2878613 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:17.280263 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bacea-3733-4a1f-8bfb-0f8be39aaf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:17.281270 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bacea-3733-4a1f-8bfb-0f8be39aaf5d None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:17.281779 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bacea-3733-4a1f-8bfb-0f8be39aaf5d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:17.282244 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bacea-3733-4a1f-8bfb-0f8be39aaf5d None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:17.283120 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bacea-3733-4a1f-8bfb-0f8be39aaf5d None admin] RBAC: Adding query filter params (name=member) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:17.283650 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bacea-3733-4a1f-8bfb-0f8be39aaf5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:17.285280 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bacea-3733-4a1f-8bfb-0f8be39aaf5d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:17.295126 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 171/332] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:05:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:17.301018 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20d1a0-323a-4b16-80c7-0f6a04ffe253 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:17.418511 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:17.429338 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20d1a0-323a-4b16-80c7-0f6a04ffe253 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:17.473881 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2287e70-53b9-4e0e-b49b-8fdaa43c7cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:17.474527 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2287e70-53b9-4e0e-b49b-8fdaa43c7cda None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:17.474804 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2287e70-53b9-4e0e-b49b-8fdaa43c7cda None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:17.475077 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2287e70-53b9-4e0e-b49b-8fdaa43c7cda None admin] PATH_INFO: `/v3/users/9c9ba5a519c1455f822d13b978dbde79` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:17.476234 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2287e70-53b9-4e0e-b49b-8fdaa43c7cda None admin] RBAC: Authorizing `identity:get_user(user_id=9c9ba5a519c1455f822d13b978dbde79)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:17.477808 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2287e70-53b9-4e0e-b49b-8fdaa43c7cda None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:17.479584 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 162/333] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:05:17 2022] GET /identity/v3/users/9c9ba5a519c1455f822d13b978dbde79 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:17.485995 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bacea-3733-4a1f-8bfb-0f8be39aaf5d None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:17.549205 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:17.589866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bacea-3733-4a1f-8bfb-0f8be39aaf5d None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:17.624953 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5703e-13f7-4a05-acd6-fc8d919198f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:17.625578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5703e-13f7-4a05-acd6-fc8d919198f9 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:17.625932 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5703e-13f7-4a05-acd6-fc8d919198f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:17.626240 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5703e-13f7-4a05-acd6-fc8d919198f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:17.626965 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5703e-13f7-4a05-acd6-fc8d919198f9 None admin] RBAC: Adding query filter params (role.id=dfd00108a3dd42f1a9dd0335f4b8f508, user.id=9c9ba5a519c1455f822d13b978dbde79, scope.system=all) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:17.627266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5703e-13f7-4a05-acd6-fc8d919198f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:17.628748 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5703e-13f7-4a05-acd6-fc8d919198f9 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:17.642050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 172/334] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Sep 23 15:05:17 2022] GET /identity/v3/role_assignments?user.id=9c9ba5a519c1455f822d13b978dbde79&scope.system=all&role.id=dfd00108a3dd42f1a9dd0335f4b8f508 => generated 510 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:19.939783 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd4358-488e-4203-8bad-2a4db5ea25ff None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:19.941190 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd4358-488e-4203-8bad-2a4db5ea25ff None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:19.941875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd4358-488e-4203-8bad-2a4db5ea25ff None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:19.943760 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 163/335] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:19.949576 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b5569-a555-40a9-95a9-11d63d12f981 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:19.950524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b5569-a555-40a9-95a9-11d63d12f981 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:19.951008 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b5569-a555-40a9-95a9-11d63d12f981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:19.974823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-ed4b5569-a555-40a9-95a9-11d63d12f981 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:19.975925 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-ed4b5569-a555-40a9-95a9-11d63d12f981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:20.072865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 173/336] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:20.159333 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dbd18-f493-4c14-a10f-c1b0bbe5fd74 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:20.159966 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dbd18-f493-4c14-a10f-c1b0bbe5fd74 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:20.160467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dbd18-f493-4c14-a10f-c1b0bbe5fd74 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:20.162436 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 164/337] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:20.168382 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae38566-e66b-4a19-a81a-ba57713aacc5 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:20.168672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae38566-e66b-4a19-a81a-ba57713aacc5 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:20.168936 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae38566-e66b-4a19-a81a-ba57713aacc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:20.190660 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-cae38566-e66b-4a19-a81a-ba57713aacc5 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:20.191843 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-cae38566-e66b-4a19-a81a-ba57713aacc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:20.248329 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:20.275389 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 174/338] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:20.517391 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2f2a4-3344-43b2-8d67-44a156d458dd None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:20.517776 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2f2a4-3344-43b2-8d67-44a156d458dd None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:20.517877 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2f2a4-3344-43b2-8d67-44a156d458dd None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:20.519507 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 165/339] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:20.525932 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b98da-a855-461b-825a-a2e954b86958 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:20.526216 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b98da-a855-461b-825a-a2e954b86958 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:20.526487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b98da-a855-461b-825a-a2e954b86958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:20.550660 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-9e7b98da-a855-461b-825a-a2e954b86958 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:20.551847 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-9e7b98da-a855-461b-825a-a2e954b86958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:20.633723 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 175/340] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:20.714529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf9157-fa48-4646-aade-0f9871b8d1c4 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:20.714884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf9157-fa48-4646-aade-0f9871b8d1c4 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:20.721364 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf9157-fa48-4646-aade-0f9871b8d1c4 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:20.721364 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 166/341] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:20.723379 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777deff-38ac-4198-881c-130cefd10434 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:20.723379 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777deff-38ac-4198-881c-130cefd10434 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:20.723379 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777deff-38ac-4198-881c-130cefd10434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:20.726469 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf9157-fa48-4646-aade-0f9871b8d1c4 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:20.751555 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-8777deff-38ac-4198-881c-130cefd10434 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:20.752731 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-8777deff-38ac-4198-881c-130cefd10434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:20.892549 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf9157-fa48-4646-aade-0f9871b8d1c4 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:20.894481 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 176/342] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:20.895365 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777deff-38ac-4198-881c-130cefd10434 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:20.948753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480cf09-8e7f-4059-8dd3-62216fc572a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:20.949407 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480cf09-8e7f-4059-8dd3-62216fc572a7 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:20.949764 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480cf09-8e7f-4059-8dd3-62216fc572a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:20.950005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480cf09-8e7f-4059-8dd3-62216fc572a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:20.962118 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480cf09-8e7f-4059-8dd3-62216fc572a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:20.968851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-9480cf09-8e7f-4059-8dd3-62216fc572a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:20.968851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:20.968851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:20.968851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:20.968851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:20.968851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:20.968851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:20.968851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:20.968851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:20.968851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:20.968851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:20.968851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:20.968851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:20.968851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:20.968851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:20.968851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:20.969823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:20.969823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:20.969823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:20.969823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:20.969823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:20.969823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:20.969823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:20.969823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:20.969823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:20.969823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:20.969823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:20.969823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:20.969823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:20.969823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:20.969823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:20.969823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:20.970647 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:20.970647 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:20.970647 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:20.970647 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:20.970647 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:20.970647 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:20.970647 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:20.970647 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:20.970647 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:20.970647 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:20.970647 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:20.970647 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:20.971274 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 167/343] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:20.973533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:20.978546 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480cf09-8e7f-4059-8dd3-62216fc572a7 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:21.018475 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:21.095868 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777deff-38ac-4198-881c-130cefd10434 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:21.139970 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480cf09-8e7f-4059-8dd3-62216fc572a7 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:21.155844 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba696f7-0fc7-4351-90e8-dfdb9d7c30ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:21.156429 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba696f7-0fc7-4351-90e8-dfdb9d7c30ef None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:21.156710 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba696f7-0fc7-4351-90e8-dfdb9d7c30ef None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:21.156984 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba696f7-0fc7-4351-90e8-dfdb9d7c30ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:21.175831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba696f7-0fc7-4351-90e8-dfdb9d7c30ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:21.180840 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-6ba696f7-0fc7-4351-90e8-dfdb9d7c30ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:05:21.180840 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:21.180840 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:21.180840 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:21.180840 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:21.180840 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:21.180840 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:21.180840 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:21.180840 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:21.180840 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:21.180840 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:21.180840 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:21.180840 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:21.180840 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:21.180840 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:21.180840 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:21.181960 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:21.181960 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:21.181960 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:21.181960 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:21.181960 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:21.181960 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:21.181960 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:21.181960 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:21.181960 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:21.181960 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:21.181960 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:21.181960 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:21.181960 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:21.181960 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:21.181960 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:21.181960 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:21.182805 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:21.182805 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:21.182805 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:21.182805 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:21.182805 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:21.182805 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:21.182805 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:21.182805 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:21.182805 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:21.182805 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:21.182805 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:05:21.182805 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:21.182805 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 177/344] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:21.189424 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba696f7-0fc7-4351-90e8-dfdb9d7c30ef None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:21.213836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eba9bf-78c6-4d73-9939-6c035f614c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:21.214453 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eba9bf-78c6-4d73-9939-6c035f614c0f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:21.214727 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eba9bf-78c6-4d73-9939-6c035f614c0f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:21.214996 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eba9bf-78c6-4d73-9939-6c035f614c0f None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:21.215653 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eba9bf-78c6-4d73-9939-6c035f614c0f None admin] RBAC: Adding query filter params (name=member) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:21.215949 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eba9bf-78c6-4d73-9939-6c035f614c0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:21.217337 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eba9bf-78c6-4d73-9939-6c035f614c0f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:21.234338 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 168/345] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:05:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:21.235173 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eba9bf-78c6-4d73-9939-6c035f614c0f None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:21.346067 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:21.348289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba696f7-0fc7-4351-90e8-dfdb9d7c30ef None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:21.358287 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:21.396751 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eba9bf-78c6-4d73-9939-6c035f614c0f None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:21.400870 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5b69d-20f3-4919-baf9-309fe94e6df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:21.401916 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5b69d-20f3-4919-baf9-309fe94e6df2 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:21.403023 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5b69d-20f3-4919-baf9-309fe94e6df2 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:21.403485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5b69d-20f3-4919-baf9-309fe94e6df2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:21.421383 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5b69d-20f3-4919-baf9-309fe94e6df2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:21.426308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-2bf5b69d-20f3-4919-baf9-309fe94e6df2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:21.426308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:21.426308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:21.426308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:21.426308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:21.426308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:21.426308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:21.426308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:21.426308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:21.426308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:21.426308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:21.426308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:21.426308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:21.426308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:21.426308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:21.426308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:21.427282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:21.427282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:21.427282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:21.427282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:21.427282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:21.427282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:21.427282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:21.427282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:21.427282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:21.427282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:21.427282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:21.427282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:21.427282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:21.427282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:21.427282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:21.427282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:21.428188 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:21.428188 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:21.428188 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:21.428188 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:21.428188 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:21.428188 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:21.428188 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:21.428188 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:21.428188 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:21.428188 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:21.428188 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:21.428188 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:21.428188 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 178/346] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:21.428869 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5b69d-20f3-4919-baf9-309fe94e6df2 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:21.471109 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a4310-fa07-437f-a856-35fcfec96dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:21.472038 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a4310-fa07-437f-a856-35fcfec96dc0 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:21.472614 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a4310-fa07-437f-a856-35fcfec96dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:21.473106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a4310-fa07-437f-a856-35fcfec96dc0 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:21.474012 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a4310-fa07-437f-a856-35fcfec96dc0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:21.474518 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a4310-fa07-437f-a856-35fcfec96dc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:21.476219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a4310-fa07-437f-a856-35fcfec96dc0 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:21.490016 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 169/347] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:05:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:21.491181 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a4310-fa07-437f-a856-35fcfec96dc0 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:21.543884 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5b69d-20f3-4919-baf9-309fe94e6df2 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:21.582634 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed79ec6-174c-43ba-8dd4-5ca07e6361a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:21.583239 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed79ec6-174c-43ba-8dd4-5ca07e6361a9 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:21.583516 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed79ec6-174c-43ba-8dd4-5ca07e6361a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:21.584131 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed79ec6-174c-43ba-8dd4-5ca07e6361a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:21.617051 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:21.631686 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a4310-fa07-437f-a856-35fcfec96dc0 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:21.664356 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed79ec6-174c-43ba-8dd4-5ca07e6361a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:21.665854 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed79ec6-174c-43ba-8dd4-5ca07e6361a9 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:21.678604 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b4437-1563-44a4-bbe3-3543e58f1933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:21.679124 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b4437-1563-44a4-bbe3-3543e58f1933 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:21.679401 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b4437-1563-44a4-bbe3-3543e58f1933 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:21.679674 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b4437-1563-44a4-bbe3-3543e58f1933 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:21.680491 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b4437-1563-44a4-bbe3-3543e58f1933 None admin] RBAC: Adding query filter params (name=member) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:21.680793 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b4437-1563-44a4-bbe3-3543e58f1933 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:21.682209 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b4437-1563-44a4-bbe3-3543e58f1933 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:21.691061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 170/348] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:05:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:21.691885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b4437-1563-44a4-bbe3-3543e58f1933 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:21.700978 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:21.789724 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 179/349] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:21.789724 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed79ec6-174c-43ba-8dd4-5ca07e6361a9 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:21.821526 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b4437-1563-44a4-bbe3-3543e58f1933 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:21.854493 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:21.870383 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6af626-749e-43d6-babe-2f9a4ad0f106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:21.871154 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6af626-749e-43d6-babe-2f9a4ad0f106 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:21.871522 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6af626-749e-43d6-babe-2f9a4ad0f106 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:21.871923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6af626-749e-43d6-babe-2f9a4ad0f106 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:21.883606 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6af626-749e-43d6-babe-2f9a4ad0f106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:21.889187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-be6af626-749e-43d6-babe-2f9a4ad0f106 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:05:21.889187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:21.889187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:21.889187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:21.889187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:21.889187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:21.889187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:21.889187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:21.889187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:21.889187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:21.889187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:21.889187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:21.889187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:21.889187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:21.889187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:21.889187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:21.890176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:21.890176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:21.890176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:21.890176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:21.890176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:21.890176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:21.890176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:21.890176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:21.890176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:21.890176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:21.890176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:21.890176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:21.890176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:21.890176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:21.890176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:21.890176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:21.892025 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:21.892025 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:21.892025 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:21.892025 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:21.892025 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:21.892025 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:21.892025 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:21.892025 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:21.892025 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:21.892025 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:21.892025 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:05:21.892025 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:21.892025 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 171/350] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 15:05:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:21.892025 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b49cb5-ac9e-4d52-9515-b664f3ea5b5f None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:21.892738 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b49cb5-ac9e-4d52-9515-b664f3ea5b5f None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:21.892738 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b49cb5-ac9e-4d52-9515-b664f3ea5b5f None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:21.897666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 172/351] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:21.898452 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b49cb5-ac9e-4d52-9515-b664f3ea5b5f None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:21.908725 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed79ec6-174c-43ba-8dd4-5ca07e6361a9 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:21.949445 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8917de3-3bf2-4bdb-bfdd-2479c2f9f26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:21.950100 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8917de3-3bf2-4bdb-bfdd-2479c2f9f26e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:21.950297 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8917de3-3bf2-4bdb-bfdd-2479c2f9f26e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:21.950548 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8917de3-3bf2-4bdb-bfdd-2479c2f9f26e None admin] PATH_INFO: `/v3/users/fa19efaf2f8147698db5184c12096241` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:21.951654 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8917de3-3bf2-4bdb-bfdd-2479c2f9f26e None admin] RBAC: Authorizing `identity:get_user(user_id=fa19efaf2f8147698db5184c12096241)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:21.953082 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8917de3-3bf2-4bdb-bfdd-2479c2f9f26e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:21.954955 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 180/352] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 15:05:21 2022] GET /identity/v3/users/fa19efaf2f8147698db5184c12096241 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:21.956195 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8917de3-3bf2-4bdb-bfdd-2479c2f9f26e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:21.978166 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:22.027215 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b49cb5-ac9e-4d52-9515-b664f3ea5b5f None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:22.071340 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782e1f0-c0c4-4e8c-b0f0-64a701b2a0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:22.072451 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782e1f0-c0c4-4e8c-b0f0-64a701b2a0c3 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:22.073254 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782e1f0-c0c4-4e8c-b0f0-64a701b2a0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:22.073776 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782e1f0-c0c4-4e8c-b0f0-64a701b2a0c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:22.079613 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8917de3-3bf2-4bdb-bfdd-2479c2f9f26e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:22.106880 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:22.121339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92ba98-f2e8-441a-ba14-4106884dfdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:22.122007 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92ba98-f2e8-441a-ba14-4106884dfdfe None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:22.122337 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92ba98-f2e8-441a-ba14-4106884dfdfe None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:22.122593 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92ba98-f2e8-441a-ba14-4106884dfdfe None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:22.123748 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92ba98-f2e8-441a-ba14-4106884dfdfe None admin] RBAC: Authorizing `identity:get_project(project_id=f366603e9ef2405c82fc9fb4c82d1ba0)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:22.125264 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92ba98-f2e8-441a-ba14-4106884dfdfe None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:22.127019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 181/353] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:21 2022] GET /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:22.127735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92ba98-f2e8-441a-ba14-4106884dfdfe None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:22.164804 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782e1f0-c0c4-4e8c-b0f0-64a701b2a0c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:22.166361 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782e1f0-c0c4-4e8c-b0f0-64a701b2a0c3 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:22.257583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:22.262337 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92ba98-f2e8-441a-ba14-4106884dfdfe None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:22.300614 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 173/354] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:22.305250 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cfc76-8c49-487e-bc35-27587fb7d13b None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:22.305250 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cfc76-8c49-487e-bc35-27587fb7d13b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:22.305250 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cfc76-8c49-487e-bc35-27587fb7d13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:22.309025 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac12e0c-d549-4c8b-ae98-34c4b5218cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:22.309724 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac12e0c-d549-4c8b-ae98-34c4b5218cf3 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:22.310014 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac12e0c-d549-4c8b-ae98-34c4b5218cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:22.310282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac12e0c-d549-4c8b-ae98-34c4b5218cf3 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:22.310993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac12e0c-d549-4c8b-ae98-34c4b5218cf3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:22.311392 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac12e0c-d549-4c8b-ae98-34c4b5218cf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:22.312896 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac12e0c-d549-4c8b-ae98-34c4b5218cf3 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:22.324031 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 182/355] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:05:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:22.324688 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-266cfc76-8c49-487e-bc35-27587fb7d13b None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:22.325564 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac12e0c-d549-4c8b-ae98-34c4b5218cf3 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:22.325937 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-266cfc76-8c49-487e-bc35-27587fb7d13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:22.403608 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:22.430055 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 174/356] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:22.430794 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cfc76-8c49-487e-bc35-27587fb7d13b None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:22.453834 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac12e0c-d549-4c8b-ae98-34c4b5218cf3 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:22.493599 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba778476-3157-409c-aaa6-0831babf89a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:22.494256 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba778476-3157-409c-aaa6-0831babf89a8 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:22.494527 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba778476-3157-409c-aaa6-0831babf89a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:22.494792 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba778476-3157-409c-aaa6-0831babf89a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:22.495510 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba778476-3157-409c-aaa6-0831babf89a8 None admin] RBAC: Adding query filter params (role.id=c3cc9c287a1d45e9ad18d3ce7b9975cb, user.id=fa19efaf2f8147698db5184c12096241, scope.system=all) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:22.495809 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba778476-3157-409c-aaa6-0831babf89a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:22.497248 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba778476-3157-409c-aaa6-0831babf89a8 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:22.517372 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 183/357] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Sep 23 15:05:22 2022] GET /identity/v3/role_assignments?user.id=fa19efaf2f8147698db5184c12096241&scope.system=all&role.id=c3cc9c287a1d45e9ad18d3ce7b9975cb => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:22.518020 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba778476-3157-409c-aaa6-0831babf89a8 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:22.554310 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:22.564019 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cfc76-8c49-487e-bc35-27587fb7d13b None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:22.603048 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375bf17-4d88-41c2-9038-f5c3b0e8ce49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:22.604122 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375bf17-4d88-41c2-9038-f5c3b0e8ce49 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:22.604587 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375bf17-4d88-41c2-9038-f5c3b0e8ce49 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:22.605043 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375bf17-4d88-41c2-9038-f5c3b0e8ce49 None admin] PATH_INFO: `/v3/groups/0a059e8c76d349c1ae2fbb08e9975062` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:22.612936 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375bf17-4d88-41c2-9038-f5c3b0e8ce49 None admin] RBAC: Authorizing `identity:get_group(group_id=0a059e8c76d349c1ae2fbb08e9975062)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:22.614886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375bf17-4d88-41c2-9038-f5c3b0e8ce49 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:22.616988 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 175/358] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 15:05:22 2022] GET /identity/v3/groups/0a059e8c76d349c1ae2fbb08e9975062 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:22.618150 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375bf17-4d88-41c2-9038-f5c3b0e8ce49 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:22.721729 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba778476-3157-409c-aaa6-0831babf89a8 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:22.740535 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375bf17-4d88-41c2-9038-f5c3b0e8ce49 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:22.748315 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:22.779438 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0371eb-b9de-48dd-a843-37a8f5bc3939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:22.780403 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0371eb-b9de-48dd-a843-37a8f5bc3939 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:22.780872 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0371eb-b9de-48dd-a843-37a8f5bc3939 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:22.781336 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0371eb-b9de-48dd-a843-37a8f5bc3939 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:22.790894 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee73ff-ef86-4718-8492-d341b688a22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:22.791623 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee73ff-ef86-4718-8492-d341b688a22d None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:22.791907 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee73ff-ef86-4718-8492-d341b688a22d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:22.792175 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee73ff-ef86-4718-8492-d341b688a22d None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:22.793633 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee73ff-ef86-4718-8492-d341b688a22d None admin] RBAC: Authorizing `identity:get_project(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:22.794900 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee73ff-ef86-4718-8492-d341b688a22d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:22.801020 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 184/359] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:22 2022] GET /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:22.801020 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee73ff-ef86-4718-8492-d341b688a22d None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:22.820799 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:22.870708 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0371eb-b9de-48dd-a843-37a8f5bc3939 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:22.872814 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0371eb-b9de-48dd-a843-37a8f5bc3939 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:22.952792 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee73ff-ef86-4718-8492-d341b688a22d None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:22.986540 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 176/360] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:22.988019 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0371eb-b9de-48dd-a843-37a8f5bc3939 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:22.990847 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e788f-d54f-417e-8992-855aed873dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:22.991505 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e788f-d54f-417e-8992-855aed873dd9 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:22.991776 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e788f-d54f-417e-8992-855aed873dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:22.992041 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e788f-d54f-417e-8992-855aed873dd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:22.992962 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e788f-d54f-417e-8992-855aed873dd9 None admin] RBAC: Adding query filter params (group.id=0a059e8c76d349c1ae2fbb08e9975062, role.id=dfd00108a3dd42f1a9dd0335f4b8f508, scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:22.993267 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e788f-d54f-417e-8992-855aed873dd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:22.994726 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e788f-d54f-417e-8992-855aed873dd9 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:23.000724 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 185/361] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Sep 23 15:05:22 2022] GET /identity/v3/role_assignments?group.id=0a059e8c76d349c1ae2fbb08e9975062&scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0&role.id=dfd00108a3dd42f1a9dd0335f4b8f508 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:23.007252 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07097c-bf33-4b6d-916f-042d2a800595 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:23.007534 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07097c-bf33-4b6d-916f-042d2a800595 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:23.007803 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07097c-bf33-4b6d-916f-042d2a800595 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:23.009502 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 186/362] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:23.010231 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07097c-bf33-4b6d-916f-042d2a800595 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:23.057819 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:23.073099 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:23.113007 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0371eb-b9de-48dd-a843-37a8f5bc3939 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:23.137143 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07097c-bf33-4b6d-916f-042d2a800595 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:23.156382 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7292a4-bc15-4995-bb84-fd165913632a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:23.157034 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7292a4-bc15-4995-bb84-fd165913632a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:23.157371 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7292a4-bc15-4995-bb84-fd165913632a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:23.157671 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7292a4-bc15-4995-bb84-fd165913632a None admin] PATH_INFO: `/v3/groups/0a059e8c76d349c1ae2fbb08e9975062` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:23.158819 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7292a4-bc15-4995-bb84-fd165913632a None admin] RBAC: Authorizing `identity:get_group(group_id=0a059e8c76d349c1ae2fbb08e9975062)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:23.160304 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7292a4-bc15-4995-bb84-fd165913632a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:23.163057 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 177/363] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 15:05:22 2022] GET /identity/v3/groups/0a059e8c76d349c1ae2fbb08e9975062 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:23.163960 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7292a4-bc15-4995-bb84-fd165913632a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:23.186070 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ed0b0-ad3a-47a9-85a7-6b3010d93831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:23.186721 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ed0b0-ad3a-47a9-85a7-6b3010d93831 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:23.186989 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ed0b0-ad3a-47a9-85a7-6b3010d93831 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:23.187251 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ed0b0-ad3a-47a9-85a7-6b3010d93831 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:23.204929 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ed0b0-ad3a-47a9-85a7-6b3010d93831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:23.210402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-366ed0b0-ad3a-47a9-85a7-6b3010d93831 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:05:23.210402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:23.210402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:23.210402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:23.210402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:23.210402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:23.210402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:23.210402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:23.210402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:23.210402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:23.210402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:23.210402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:23.210402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:23.210402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:23.210402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:23.210402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:23.211457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:23.211457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:23.211457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:23.211457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:23.211457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:23.211457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:23.211457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:23.211457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:23.211457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:23.211457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:23.211457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:23.211457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:23.211457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:23.211457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:23.211457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:23.211457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:23.212268 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:23.212268 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:23.212268 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:23.212268 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:23.212268 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:23.212268 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:23.212268 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:23.212268 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:23.212268 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:23.212268 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:23.212268 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:05:23.212268 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:23.212268 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 187/364] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 15:05:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:23.212976 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c2007-a1e9-493b-82d7-01f825f20a39 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:23.213570 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c2007-a1e9-493b-82d7-01f825f20a39 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:23.213570 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c2007-a1e9-493b-82d7-01f825f20a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:23.233005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-f34c2007-a1e9-493b-82d7-01f825f20a39 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:23.234236 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-f34c2007-a1e9-493b-82d7-01f825f20a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:23.297656 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7292a4-bc15-4995-bb84-fd165913632a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:23.317634 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 188/365] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:23.319139 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c2007-a1e9-493b-82d7-01f825f20a39 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:23.334058 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:23.341362 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca272cb-885a-4fc2-aa4e-cd8d65ef6f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:23.342031 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca272cb-885a-4fc2-aa4e-cd8d65ef6f05 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:23.342836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca272cb-885a-4fc2-aa4e-cd8d65ef6f05 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:23.343112 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca272cb-885a-4fc2-aa4e-cd8d65ef6f05 None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:23.344511 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca272cb-885a-4fc2-aa4e-cd8d65ef6f05 None admin] RBAC: Authorizing `identity:get_project(project_id=f366603e9ef2405c82fc9fb4c82d1ba0)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:23.346932 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca272cb-885a-4fc2-aa4e-cd8d65ef6f05 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:23.349640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 178/366] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:23 2022] GET /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:23.350537 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca272cb-885a-4fc2-aa4e-cd8d65ef6f05 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:23.370447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:23.439969 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c2007-a1e9-493b-82d7-01f825f20a39 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:23.485047 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573927d-d347-4288-bc72-af83d47fca2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:23.486070 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573927d-d347-4288-bc72-af83d47fca2f None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:23.486537 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573927d-d347-4288-bc72-af83d47fca2f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:23.487012 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573927d-d347-4288-bc72-af83d47fca2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:23.487348 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca272cb-885a-4fc2-aa4e-cd8d65ef6f05 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:23.488139 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573927d-d347-4288-bc72-af83d47fca2f None admin] RBAC: Adding query filter params (group.id=0a059e8c76d349c1ae2fbb08e9975062, role.id=dfd00108a3dd42f1a9dd0335f4b8f508, scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:23.488651 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573927d-d347-4288-bc72-af83d47fca2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:23.491451 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573927d-d347-4288-bc72-af83d47fca2f None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:23.498686 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 189/367] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Sep 23 15:05:23 2022] GET /identity/v3/role_assignments?group.id=0a059e8c76d349c1ae2fbb08e9975062&scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c&role.id=dfd00108a3dd42f1a9dd0335f4b8f508 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:23.499701 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573927d-d347-4288-bc72-af83d47fca2f None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:23.537135 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc731da-662a-419c-bf8e-a8d064020cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:23.538128 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc731da-662a-419c-bf8e-a8d064020cc2 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:23.538574 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc731da-662a-419c-bf8e-a8d064020cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:23.539377 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc731da-662a-419c-bf8e-a8d064020cc2 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:23.541252 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc731da-662a-419c-bf8e-a8d064020cc2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:23.541780 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc731da-662a-419c-bf8e-a8d064020cc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:23.543408 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc731da-662a-419c-bf8e-a8d064020cc2 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:23.555795 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 179/368] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:05:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:23.564415 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc731da-662a-419c-bf8e-a8d064020cc2 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:23.661002 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573927d-d347-4288-bc72-af83d47fca2f None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:23.666813 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:23.695403 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:23.712791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433cec6-9002-4537-8b0b-bb02fd07f67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:23.714383 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433cec6-9002-4537-8b0b-bb02fd07f67d None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:23.714656 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433cec6-9002-4537-8b0b-bb02fd07f67d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:23.714922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433cec6-9002-4537-8b0b-bb02fd07f67d None admin] PATH_INFO: `/v3/groups/0a059e8c76d349c1ae2fbb08e9975062` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:23.722382 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433cec6-9002-4537-8b0b-bb02fd07f67d None admin] RBAC: Authorizing `identity:get_group(group_id=0a059e8c76d349c1ae2fbb08e9975062)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:23.723838 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433cec6-9002-4537-8b0b-bb02fd07f67d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:23.725570 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 190/369] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 15:05:23 2022] GET /identity/v3/groups/0a059e8c76d349c1ae2fbb08e9975062 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:23.731247 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433cec6-9002-4537-8b0b-bb02fd07f67d None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:23.765476 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc731da-662a-419c-bf8e-a8d064020cc2 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:23.811993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba5979-7bbf-4434-89fa-ba240c8eee4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:23.812626 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5979-7bbf-4434-89fa-ba240c8eee4b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:23.812968 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5979-7bbf-4434-89fa-ba240c8eee4b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:23.813675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5979-7bbf-4434-89fa-ba240c8eee4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:23.869505 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433cec6-9002-4537-8b0b-bb02fd07f67d None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:23.928895 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ae2c0-6704-4c7d-beaa-2359bf9e9931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:23.929454 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ae2c0-6704-4c7d-beaa-2359bf9e9931 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:23.929751 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ae2c0-6704-4c7d-beaa-2359bf9e9931 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:23.930093 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ae2c0-6704-4c7d-beaa-2359bf9e9931 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:23.933377 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba5979-7bbf-4434-89fa-ba240c8eee4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:23.935112 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba5979-7bbf-4434-89fa-ba240c8eee4b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:23.941808 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ae2c0-6704-4c7d-beaa-2359bf9e9931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:23.947518 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-ed1ae2c0-6704-4c7d-beaa-2359bf9e9931 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:05:23.947518 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:23.947518 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:23.947518 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:23.947518 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:23.947518 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:23.947518 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:23.947518 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:23.947518 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:23.947518 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:23.947518 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:23.947518 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:23.947518 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:23.947518 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:23.947518 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:23.947518 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:23.948433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:23.948433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:23.948433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:23.948433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:23.948433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:23.948433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:23.948433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:23.948433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:23.948433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:23.948433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:23.948433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:23.948433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:23.948433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:23.948433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:23.948433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:23.948433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:23.949922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:23.949922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:23.949922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:23.949922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:23.949922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:23.949922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:23.949922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:23.949922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:23.949922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:23.949922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:23.949922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:05:23.949922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:23.949922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 191/370] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 15:05:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:23.949922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ae2c0-6704-4c7d-beaa-2359bf9e9931 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:23.987138 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:24.005377 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:24.056406 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 180/371] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 15:05:24.057733 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba5979-7bbf-4434-89fa-ba240c8eee4b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:24.068643 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ae2c0-6704-4c7d-beaa-2359bf9e9931 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:24.105518 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3713a-5036-4e48-8d69-5ca1a1e95e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:24.106211 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3713a-5036-4e48-8d69-5ca1a1e95e4e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:24.106783 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3713a-5036-4e48-8d69-5ca1a1e95e4e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:24.107042 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3713a-5036-4e48-8d69-5ca1a1e95e4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:24.107752 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3713a-5036-4e48-8d69-5ca1a1e95e4e None admin] RBAC: Adding query filter params (group.id=0a059e8c76d349c1ae2fbb08e9975062, role.id=877977a662dd49daab1ee42ba834153e, scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:24.108049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3713a-5036-4e48-8d69-5ca1a1e95e4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:24.109596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3713a-5036-4e48-8d69-5ca1a1e95e4e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:24.115688 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 192/372] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Sep 23 15:05:23 2022] GET /identity/v3/role_assignments?group.id=0a059e8c76d349c1ae2fbb08e9975062&scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0&role.id=877977a662dd49daab1ee42ba834153e => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:24.116485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3713a-5036-4e48-8d69-5ca1a1e95e4e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:24.203158 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba5979-7bbf-4434-89fa-ba240c8eee4b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:24.246068 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3428a-5797-4ebb-8229-0700978641f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:24.247090 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3428a-5797-4ebb-8229-0700978641f2 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:24.247564 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3428a-5797-4ebb-8229-0700978641f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:24.248054 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3428a-5797-4ebb-8229-0700978641f2 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:24.248929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3428a-5797-4ebb-8229-0700978641f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:24.249432 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3428a-5797-4ebb-8229-0700978641f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:24.251221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3428a-5797-4ebb-8229-0700978641f2 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:24.256795 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:24.265462 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 181/373] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:24.269916 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3713a-5036-4e48-8d69-5ca1a1e95e4e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:24.270250 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3428a-5797-4ebb-8229-0700978641f2 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:24.299630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:24.353148 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab605104-459e-47bd-9525-d800504c7e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:24.354191 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab605104-459e-47bd-9525-d800504c7e58 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:24.354669 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab605104-459e-47bd-9525-d800504c7e58 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:24.355100 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab605104-459e-47bd-9525-d800504c7e58 None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:24.360100 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab605104-459e-47bd-9525-d800504c7e58 None admin] RBAC: Authorizing `identity:get_project(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:24.361920 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab605104-459e-47bd-9525-d800504c7e58 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:24.364321 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 193/374] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:24 2022] GET /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:24.370081 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab605104-459e-47bd-9525-d800504c7e58 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:24.396715 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3428a-5797-4ebb-8229-0700978641f2 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:24.438990 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e5770-8fa1-41ba-9881-67c0fa170720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:24.439981 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e5770-8fa1-41ba-9881-67c0fa170720 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:24.440278 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e5770-8fa1-41ba-9881-67c0fa170720 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:24.440554 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e5770-8fa1-41ba-9881-67c0fa170720 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:24.522529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e5770-8fa1-41ba-9881-67c0fa170720 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:24.524591 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e5770-8fa1-41ba-9881-67c0fa170720 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:24.549232 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:24.592009 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab605104-459e-47bd-9525-d800504c7e58 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:24.649740 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 182/375] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:24.657306 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e5770-8fa1-41ba-9881-67c0fa170720 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:24.658111 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c69bc-909e-478b-82a5-6307b6e2e803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:24.658761 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c69bc-909e-478b-82a5-6307b6e2e803 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:24.659038 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c69bc-909e-478b-82a5-6307b6e2e803 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:24.659409 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c69bc-909e-478b-82a5-6307b6e2e803 None admin] PATH_INFO: `/v3/groups/0a059e8c76d349c1ae2fbb08e9975062` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:24.662598 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c69bc-909e-478b-82a5-6307b6e2e803 None admin] RBAC: Authorizing `identity:get_group(group_id=0a059e8c76d349c1ae2fbb08e9975062)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:24.664060 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c69bc-909e-478b-82a5-6307b6e2e803 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:24.665715 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 194/376] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 15:05:24 2022] GET /identity/v3/groups/0a059e8c76d349c1ae2fbb08e9975062 => generated 226 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:24.674769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c69bc-909e-478b-82a5-6307b6e2e803 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:24.751198 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:24.821150 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e5770-8fa1-41ba-9881-67c0fa170720 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:24.856186 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:24.863129 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686f387-2a89-479f-92ef-0e86d45221bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:24.863827 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686f387-2a89-479f-92ef-0e86d45221bb None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:24.864133 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686f387-2a89-479f-92ef-0e86d45221bb None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:24.864472 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686f387-2a89-479f-92ef-0e86d45221bb None admin] PATH_INFO: `/v3/projects/c6971859b35b44e69f745ee34120421d` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:24.865648 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686f387-2a89-479f-92ef-0e86d45221bb None admin] RBAC: Authorizing `identity:get_project(project_id=c6971859b35b44e69f745ee34120421d)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:24.867372 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686f387-2a89-479f-92ef-0e86d45221bb None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:24.869529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 183/377] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:24 2022] GET /identity/v3/projects/c6971859b35b44e69f745ee34120421d => generated 344 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:24.875331 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686f387-2a89-479f-92ef-0e86d45221bb None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:24.876397 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c69bc-909e-478b-82a5-6307b6e2e803 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:24.930386 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876716f4-fde2-4208-8aca-02d494d98f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:24.931017 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876716f4-fde2-4208-8aca-02d494d98f36 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:24.931296 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876716f4-fde2-4208-8aca-02d494d98f36 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:24.931566 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876716f4-fde2-4208-8aca-02d494d98f36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:24.932296 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876716f4-fde2-4208-8aca-02d494d98f36 None admin] RBAC: Adding query filter params (group.id=0a059e8c76d349c1ae2fbb08e9975062, role.id=877977a662dd49daab1ee42ba834153e, scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:24.932601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876716f4-fde2-4208-8aca-02d494d98f36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:24.934075 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876716f4-fde2-4208-8aca-02d494d98f36 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:24.951082 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 195/378] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Sep 23 15:05:24 2022] GET /identity/v3/role_assignments?group.id=0a059e8c76d349c1ae2fbb08e9975062&scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c&role.id=877977a662dd49daab1ee42ba834153e => generated 260 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:25.048079 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686f387-2a89-479f-92ef-0e86d45221bb None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:25.099852 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f6f66-6326-4394-b638-cdfaa734b3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:25.100419 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f6f66-6326-4394-b638-cdfaa734b3de None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:25.100695 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f6f66-6326-4394-b638-cdfaa734b3de None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:25.100966 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f6f66-6326-4394-b638-cdfaa734b3de None admin] PATH_INFO: `/v3/groups/a5999b6fc50949119f9b2f951bb1f65d` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:25.109716 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f6f66-6326-4394-b638-cdfaa734b3de None admin] RBAC: Authorizing `identity:get_group(group_id=a5999b6fc50949119f9b2f951bb1f65d)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:25.111183 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f6f66-6326-4394-b638-cdfaa734b3de None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:25.113167 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 184/379] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 15:05:24 2022] GET /identity/v3/groups/a5999b6fc50949119f9b2f951bb1f65d => generated 229 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:25.119352 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876716f4-fde2-4208-8aca-02d494d98f36 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:25.280716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:25.287885 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876716f4-fde2-4208-8aca-02d494d98f36 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:25.328480 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b59e8-6f87-46a6-ac5c-7ddca73d4f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:25.329097 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b59e8-6f87-46a6-ac5c-7ddca73d4f87 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:25.329375 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b59e8-6f87-46a6-ac5c-7ddca73d4f87 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:25.329646 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b59e8-6f87-46a6-ac5c-7ddca73d4f87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:25.330464 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b59e8-6f87-46a6-ac5c-7ddca73d4f87 None admin] RBAC: Adding query filter params (group.id=a5999b6fc50949119f9b2f951bb1f65d, role.id=07d4069c848d4ee9abb586256ee26f20, scope.project.id=c6971859b35b44e69f745ee34120421d) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:25.330769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b59e8-6f87-46a6-ac5c-7ddca73d4f87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:25.332220 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b59e8-6f87-46a6-ac5c-7ddca73d4f87 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:25.340429 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 196/380] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Sep 23 15:05:25 2022] GET /identity/v3/role_assignments?group.id=a5999b6fc50949119f9b2f951bb1f65d&scope.project.id=c6971859b35b44e69f745ee34120421d&role.id=07d4069c848d4ee9abb586256ee26f20 => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:26.105190 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522bfa5-568b-43ba-ad66-37e1eeadaf6a None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:26.105754 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522bfa5-568b-43ba-ad66-37e1eeadaf6a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:26.105754 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522bfa5-568b-43ba-ad66-37e1eeadaf6a None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:26.107476 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 185/381] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:26.113335 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd856fca-b3c9-484c-be93-9bddb1dc12d6 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:26.113957 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd856fca-b3c9-484c-be93-9bddb1dc12d6 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:26.114459 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd856fca-b3c9-484c-be93-9bddb1dc12d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:26.142944 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-fd856fca-b3c9-484c-be93-9bddb1dc12d6 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:26.144505 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-fd856fca-b3c9-484c-be93-9bddb1dc12d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:26.236065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 197/382] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:26.762827 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e76fd-ab4f-4812-a2b6-320cc1b78521 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:26.763453 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e76fd-ab4f-4812-a2b6-320cc1b78521 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:26.763935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e76fd-ab4f-4812-a2b6-320cc1b78521 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:26.765763 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 186/383] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:26.771331 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e76fd-ab4f-4812-a2b6-320cc1b78521 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:26.771590 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0ac9a-8c7a-4027-8131-ca5bb5785717 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:26.772017 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0ac9a-8c7a-4027-8131-ca5bb5785717 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:26.772168 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0ac9a-8c7a-4027-8131-ca5bb5785717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:26.798683 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-bed0ac9a-8c7a-4027-8131-ca5bb5785717 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:26.799920 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-bed0ac9a-8c7a-4027-8131-ca5bb5785717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:26.829029 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:26.880438 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e76fd-ab4f-4812-a2b6-320cc1b78521 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:26.916357 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e789e-8e8b-42f1-b42d-8e144a3f9614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:26.917345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e789e-8e8b-42f1-b42d-8e144a3f9614 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:26.917839 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e789e-8e8b-42f1-b42d-8e144a3f9614 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:26.918321 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e789e-8e8b-42f1-b42d-8e144a3f9614 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:26.927922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 198/384] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:26.929361 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e789e-8e8b-42f1-b42d-8e144a3f9614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:26.935618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-a72e789e-8e8b-42f1-b42d-8e144a3f9614 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:26.935618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:26.935618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:26.935618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:26.935618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:26.935618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:26.935618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:26.935618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:26.935618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:26.935618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:26.935618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:26.935618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:26.935618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:26.935618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:26.935618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:26.935618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:26.936603 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:26.936603 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:26.936603 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:26.936603 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:26.936603 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:26.936603 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:26.936603 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:26.936603 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:26.936603 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:26.936603 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:26.936603 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:26.936603 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:26.936603 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:26.936603 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:26.936603 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:26.936603 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:26.937492 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:26.937492 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:26.937492 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:26.937492 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:26.937492 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:26.937492 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:26.937492 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:26.937492 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:26.937492 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:26.937492 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:26.937492 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:26.937492 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:26.939850 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 187/385] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:05:26.946714 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0ac9a-8c7a-4027-8131-ca5bb5785717 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:26.979450 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:27.086483 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0ac9a-8c7a-4027-8131-ca5bb5785717 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:27.128130 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392ff15-85b3-427e-9fc4-bceaf8e7a44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:27.128745 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392ff15-85b3-427e-9fc4-bceaf8e7a44d None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:27.129016 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392ff15-85b3-427e-9fc4-bceaf8e7a44d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:27.129288 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392ff15-85b3-427e-9fc4-bceaf8e7a44d None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:27.130049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392ff15-85b3-427e-9fc4-bceaf8e7a44d None admin] RBAC: Adding query filter params (name=member) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:27.130315 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392ff15-85b3-427e-9fc4-bceaf8e7a44d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:27.131702 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392ff15-85b3-427e-9fc4-bceaf8e7a44d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:27.140419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 199/386] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:05:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:27.145893 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e789e-8e8b-42f1-b42d-8e144a3f9614 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:27.250501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e789e-8e8b-42f1-b42d-8e144a3f9614 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:27.268397 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:27.296437 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee1a2b-a245-477a-9ffd-46b3375a8f53 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:27.296718 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee1a2b-a245-477a-9ffd-46b3375a8f53 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:27.296995 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee1a2b-a245-477a-9ffd-46b3375a8f53 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:27.298724 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 200/387] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:05:27.302276 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03643091-1d6f-4301-a362-7ed55bd5bbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:27.302978 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03643091-1d6f-4301-a362-7ed55bd5bbfc None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:27.303259 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03643091-1d6f-4301-a362-7ed55bd5bbfc None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:27.303530 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03643091-1d6f-4301-a362-7ed55bd5bbfc None admin] PATH_INFO: `/v3/groups/0a059e8c76d349c1ae2fbb08e9975062` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:27.304265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88822ece-214b-43ae-9b43-daa774b3d50b None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:27.304546 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88822ece-214b-43ae-9b43-daa774b3d50b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:27.304639 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03643091-1d6f-4301-a362-7ed55bd5bbfc None admin] RBAC: Authorizing `identity:get_group(group_id=0a059e8c76d349c1ae2fbb08e9975062)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:27.304815 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88822ece-214b-43ae-9b43-daa774b3d50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:27.306291 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03643091-1d6f-4301-a362-7ed55bd5bbfc None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:27.307994 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 188/388] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 15:05:27 2022] GET /identity/v3/groups/0a059e8c76d349c1ae2fbb08e9975062 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:27.313271 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03643091-1d6f-4301-a362-7ed55bd5bbfc None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:27.324654 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-88822ece-214b-43ae-9b43-daa774b3d50b None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:27.325866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-88822ece-214b-43ae-9b43-daa774b3d50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:27.401811 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 201/389] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:27.402734 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88822ece-214b-43ae-9b43-daa774b3d50b None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:27.418284 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:27.427688 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03643091-1d6f-4301-a362-7ed55bd5bbfc None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:27.464124 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f212f69-dffb-4c4b-91c1-805ca1a8538a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:27.465051 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f212f69-dffb-4c4b-91c1-805ca1a8538a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:27.465461 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f212f69-dffb-4c4b-91c1-805ca1a8538a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:27.465909 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f212f69-dffb-4c4b-91c1-805ca1a8538a None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:27.467403 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f212f69-dffb-4c4b-91c1-805ca1a8538a None admin] RBAC: Authorizing `identity:get_project(project_id=f366603e9ef2405c82fc9fb4c82d1ba0)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:27.469045 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f212f69-dffb-4c4b-91c1-805ca1a8538a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:27.471347 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 189/390] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:27 2022] GET /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:27.483060 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f212f69-dffb-4c4b-91c1-805ca1a8538a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:27.554145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88822ece-214b-43ae-9b43-daa774b3d50b None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:27.590871 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:27.591792 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2dac3f-1d52-4257-8a01-79bcec6b3be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:27.592755 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2dac3f-1d52-4257-8a01-79bcec6b3be6 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:27.593273 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2dac3f-1d52-4257-8a01-79bcec6b3be6 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:27.593706 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2dac3f-1d52-4257-8a01-79bcec6b3be6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:27.605447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2dac3f-1d52-4257-8a01-79bcec6b3be6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:27.610971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-aa2dac3f-1d52-4257-8a01-79bcec6b3be6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:27.610971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:27.610971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:27.610971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:27.610971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:27.610971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:27.610971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:27.610971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:27.610971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:27.610971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:27.610971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:27.610971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:27.610971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:27.610971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:27.610971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:27.610971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:27.612027 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:27.612027 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:27.612027 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:27.612027 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:27.612027 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:27.612027 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:27.612027 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:27.612027 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:27.612027 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:27.612027 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:27.612027 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:27.612027 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:27.612027 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:27.612027 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:27.612027 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:27.612027 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:27.613066 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:27.613066 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:27.613066 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:27.613066 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:27.613066 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:27.613066 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:27.613066 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:27.613066 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:27.613066 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:27.613066 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:27.613066 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:27.613066 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:27.615509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 202/391] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:27.623662 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2dac3f-1d52-4257-8a01-79bcec6b3be6 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:27.691503 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f212f69-dffb-4c4b-91c1-805ca1a8538a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:27.735378 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:27.764992 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2dac3f-1d52-4257-8a01-79bcec6b3be6 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:27.800266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df8e8f-04cf-4420-a5be-72e347ddbddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:27.801712 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df8e8f-04cf-4420-a5be-72e347ddbddf None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:27.802182 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df8e8f-04cf-4420-a5be-72e347ddbddf None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:27.802632 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df8e8f-04cf-4420-a5be-72e347ddbddf None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:27.803467 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df8e8f-04cf-4420-a5be-72e347ddbddf None admin] RBAC: Adding query filter params (name=member) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:27.803946 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df8e8f-04cf-4420-a5be-72e347ddbddf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:27.805677 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df8e8f-04cf-4420-a5be-72e347ddbddf None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:27.814457 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459fcbd-03ed-43d1-8a37-93263e74ee30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:27.814724 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 203/392] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:05:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:27.819192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459fcbd-03ed-43d1-8a37-93263e74ee30 None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:27.819192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459fcbd-03ed-43d1-8a37-93263e74ee30 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:27.819192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459fcbd-03ed-43d1-8a37-93263e74ee30 None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0/groups/0a059e8c76d349c1ae2fbb08e9975062/roles/dfd00108a3dd42f1a9dd0335f4b8f508` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:27.820434 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df8e8f-04cf-4420-a5be-72e347ddbddf None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:27.826476 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459fcbd-03ed-43d1-8a37-93263e74ee30 None admin] RBAC: Authorizing `identity:create_grant(project_id=f366603e9ef2405c82fc9fb4c82d1ba0, group_id=0a059e8c76d349c1ae2fbb08e9975062, role_id=dfd00108a3dd42f1a9dd0335f4b8f508)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:27.827939 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459fcbd-03ed-43d1-8a37-93263e74ee30 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:27.847241 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 190/393] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Sep 23 15:05:27 2022] PUT /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0/groups/0a059e8c76d349c1ae2fbb08e9975062/roles/dfd00108a3dd42f1a9dd0335f4b8f508 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:05:27.848294 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459fcbd-03ed-43d1-8a37-93263e74ee30 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:27.932130 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df8e8f-04cf-4420-a5be-72e347ddbddf None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:27.964661 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459fcbd-03ed-43d1-8a37-93263e74ee30 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:27.966062 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:27.973679 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265667c-f511-4e2f-852d-cec5e9499149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:27.974813 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265667c-f511-4e2f-852d-cec5e9499149 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:27.975353 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265667c-f511-4e2f-852d-cec5e9499149 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:27.975870 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265667c-f511-4e2f-852d-cec5e9499149 None admin] PATH_INFO: `/v3/groups/0a059e8c76d349c1ae2fbb08e9975062` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:27.978331 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265667c-f511-4e2f-852d-cec5e9499149 None admin] RBAC: Authorizing `identity:get_group(group_id=0a059e8c76d349c1ae2fbb08e9975062)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:27.980318 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265667c-f511-4e2f-852d-cec5e9499149 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:27.982739 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 204/394] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 15:05:27 2022] GET /identity/v3/groups/0a059e8c76d349c1ae2fbb08e9975062 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:27.984064 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c7c34-e9f9-4e6c-89dd-4b73986ceec5 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:27.984422 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c7c34-e9f9-4e6c-89dd-4b73986ceec5 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:27.984709 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c7c34-e9f9-4e6c-89dd-4b73986ceec5 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:27.991953 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 205/395] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:27.996449 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c7c34-e9f9-4e6c-89dd-4b73986ceec5 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:27.998163 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:28.032774 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832210b-be90-4ba1-a9a8-2e3a72945a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:28.033539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832210b-be90-4ba1-a9a8-2e3a72945a8f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:28.033906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832210b-be90-4ba1-a9a8-2e3a72945a8f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:28.034261 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832210b-be90-4ba1-a9a8-2e3a72945a8f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:28.048973 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832210b-be90-4ba1-a9a8-2e3a72945a8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:28.055257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-4832210b-be90-4ba1-a9a8-2e3a72945a8f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:05:28.055257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:28.055257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:28.055257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:28.055257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:28.055257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:28.055257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:28.055257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:28.055257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:28.055257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:28.055257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:28.055257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:28.055257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:28.055257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:28.055257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:28.055257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:28.056302 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:28.056302 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:28.056302 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:28.056302 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:28.056302 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:28.056302 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:28.056302 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:28.056302 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:28.056302 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:28.056302 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:28.056302 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:28.056302 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:28.056302 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:28.056302 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:28.056302 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:28.056302 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:28.057141 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:28.057141 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:28.057141 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:28.057141 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:28.057141 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:28.057141 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:28.057141 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:28.057141 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:28.057141 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:28.057141 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:28.057141 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:05:28.057141 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:28.057789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 191/396] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 15:05:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:28.059282 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f972c00-2964-41df-87c4-a208b4b11b5c None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:28.059655 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f972c00-2964-41df-87c4-a208b4b11b5c None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:28.060015 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f972c00-2964-41df-87c4-a208b4b11b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:28.085474 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-3f972c00-2964-41df-87c4-a208b4b11b5c None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:28.087090 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-3f972c00-2964-41df-87c4-a208b4b11b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:28.133290 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c7c34-e9f9-4e6c-89dd-4b73986ceec5 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:28.166775 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 192/397] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:28.167640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f972c00-2964-41df-87c4-a208b4b11b5c None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:28.177742 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026280fb-c4a2-4eb0-a7b5-ac28525bd346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:28.178722 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026280fb-c4a2-4eb0-a7b5-ac28525bd346 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:28.178997 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026280fb-c4a2-4eb0-a7b5-ac28525bd346 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:28.179266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026280fb-c4a2-4eb0-a7b5-ac28525bd346 None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:28.181009 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026280fb-c4a2-4eb0-a7b5-ac28525bd346 None admin] RBAC: Authorizing `identity:get_project(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:28.182665 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026280fb-c4a2-4eb0-a7b5-ac28525bd346 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:28.185719 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 206/398] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:27 2022] GET /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:28.191370 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026280fb-c4a2-4eb0-a7b5-ac28525bd346 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:28.275550 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:28.279805 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f972c00-2964-41df-87c4-a208b4b11b5c None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:28.286534 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:28.316475 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d840-bde5-455c-a1a4-99c197788d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:28.317247 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d840-bde5-455c-a1a4-99c197788d7f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:28.317579 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d840-bde5-455c-a1a4-99c197788d7f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:28.317935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d840-bde5-455c-a1a4-99c197788d7f None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:28.318653 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43d840-bde5-455c-a1a4-99c197788d7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:28.319036 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43d840-bde5-455c-a1a4-99c197788d7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:28.320474 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43d840-bde5-455c-a1a4-99c197788d7f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:28.330035 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026280fb-c4a2-4eb0-a7b5-ac28525bd346 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:28.331739 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 193/399] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:05:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:28.340684 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d840-bde5-455c-a1a4-99c197788d7f None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:28.374513 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c32213-ea46-4e90-9e63-f645dd17425c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:28.377215 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c32213-ea46-4e90-9e63-f645dd17425c None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:28.377899 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c32213-ea46-4e90-9e63-f645dd17425c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:28.378180 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c32213-ea46-4e90-9e63-f645dd17425c None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c/groups/0a059e8c76d349c1ae2fbb08e9975062/roles/dfd00108a3dd42f1a9dd0335f4b8f508` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:28.382500 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c32213-ea46-4e90-9e63-f645dd17425c None admin] RBAC: Authorizing `identity:create_grant(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c, group_id=0a059e8c76d349c1ae2fbb08e9975062, role_id=dfd00108a3dd42f1a9dd0335f4b8f508)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:28.386194 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c32213-ea46-4e90-9e63-f645dd17425c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:28.413842 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 207/400] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Sep 23 15:05:28 2022] PUT /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c/groups/0a059e8c76d349c1ae2fbb08e9975062/roles/dfd00108a3dd42f1a9dd0335f4b8f508 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:05:28.417505 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bcf46-388f-467e-ba82-d8ed37e38761 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:28.417902 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bcf46-388f-467e-ba82-d8ed37e38761 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:28.418174 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bcf46-388f-467e-ba82-d8ed37e38761 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:28.423428 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 208/401] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:05:28.425095 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71c8be-6c23-45dd-bdc4-5c8bc4cd1f20 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:28.425460 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71c8be-6c23-45dd-bdc4-5c8bc4cd1f20 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:28.425843 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71c8be-6c23-45dd-bdc4-5c8bc4cd1f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:28.445615 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-bf71c8be-6c23-45dd-bdc4-5c8bc4cd1f20 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:28.447044 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-bf71c8be-6c23-45dd-bdc4-5c8bc4cd1f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:28.531014 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d840-bde5-455c-a1a4-99c197788d7f None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:28.580120 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 209/402] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:28.589208 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b11b5-41a9-4e9b-ad61-8bea24c172ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:28.590186 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b11b5-41a9-4e9b-ad61-8bea24c172ee None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:28.590591 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b11b5-41a9-4e9b-ad61-8bea24c172ee None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:28.590983 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b11b5-41a9-4e9b-ad61-8bea24c172ee None admin] PATH_INFO: `/v3/groups/0a059e8c76d349c1ae2fbb08e9975062` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:28.592664 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b11b5-41a9-4e9b-ad61-8bea24c172ee None admin] RBAC: Authorizing `identity:get_group(group_id=0a059e8c76d349c1ae2fbb08e9975062)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:28.595215 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b11b5-41a9-4e9b-ad61-8bea24c172ee None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:28.603333 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71c8be-6c23-45dd-bdc4-5c8bc4cd1f20 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:28.609668 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 194/403] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 15:05:28 2022] GET /identity/v3/groups/0a059e8c76d349c1ae2fbb08e9975062 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:28.615226 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b11b5-41a9-4e9b-ad61-8bea24c172ee None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:28.670088 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:28.714962 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:28.763810 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b11b5-41a9-4e9b-ad61-8bea24c172ee None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:28.771533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71c8be-6c23-45dd-bdc4-5c8bc4cd1f20 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:28.806232 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d691d0d-38a9-4b4b-89c6-2a8412f79ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:28.807196 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d691d0d-38a9-4b4b-89c6-2a8412f79ea6 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:28.807621 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d691d0d-38a9-4b4b-89c6-2a8412f79ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:28.808024 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d691d0d-38a9-4b4b-89c6-2a8412f79ea6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:28.820204 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d691d0d-38a9-4b4b-89c6-2a8412f79ea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:28.825279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-2d691d0d-38a9-4b4b-89c6-2a8412f79ea6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:05:28.825279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:28.825279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:28.825279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:28.825279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:28.825279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:28.825279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:28.825279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:28.825279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:28.825279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:28.825279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:28.825279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:28.825279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:28.825279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:28.825279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:28.825279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:28.826425 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:28.826425 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:28.826425 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:28.826425 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:28.826425 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:28.826425 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:28.826425 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:28.826425 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:28.826425 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:28.826425 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:28.826425 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:28.826425 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:28.826425 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:28.826425 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:28.826425 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:28.826425 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:28.827414 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:28.827414 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:28.827414 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:28.827414 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:28.827414 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:28.827414 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:28.827414 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:28.827414 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:28.827414 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:28.827414 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:28.827414 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:05:28.827414 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:28.830211 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 195/404] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 15:05:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:28.835664 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d691d0d-38a9-4b4b-89c6-2a8412f79ea6 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:28.847246 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ebd1d-84bf-400c-be6a-c5012c8a7fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:28.847887 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ebd1d-84bf-400c-be6a-c5012c8a7fe2 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:28.848156 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ebd1d-84bf-400c-be6a-c5012c8a7fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:28.848419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ebd1d-84bf-400c-be6a-c5012c8a7fe2 None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:28.854362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ebd1d-84bf-400c-be6a-c5012c8a7fe2 None admin] RBAC: Authorizing `identity:get_project(project_id=f366603e9ef2405c82fc9fb4c82d1ba0)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:28.855813 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ebd1d-84bf-400c-be6a-c5012c8a7fe2 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:28.861239 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 210/405] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:28 2022] GET /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:28.868565 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ebd1d-84bf-400c-be6a-c5012c8a7fe2 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:28.995715 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:29.007714 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d691d0d-38a9-4b4b-89c6-2a8412f79ea6 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:29.040818 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ebd1d-84bf-400c-be6a-c5012c8a7fe2 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:29.047010 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546c72b-b4a3-4fae-9c08-f1a79549935a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:29.047739 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546c72b-b4a3-4fae-9c08-f1a79549935a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:29.048111 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546c72b-b4a3-4fae-9c08-f1a79549935a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:29.048478 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546c72b-b4a3-4fae-9c08-f1a79549935a None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:29.049232 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546c72b-b4a3-4fae-9c08-f1a79549935a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:29.049630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546c72b-b4a3-4fae-9c08-f1a79549935a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:29.051333 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546c72b-b4a3-4fae-9c08-f1a79549935a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:29.060560 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 196/406] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:05:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:29.061482 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546c72b-b4a3-4fae-9c08-f1a79549935a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:29.069874 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:29.078680 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308e4d0-7fd8-464a-8b89-8976ec962ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:29.079740 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308e4d0-7fd8-464a-8b89-8976ec962ec1 None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:29.080104 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308e4d0-7fd8-464a-8b89-8976ec962ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:29.080342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308e4d0-7fd8-464a-8b89-8976ec962ec1 None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0/groups/0a059e8c76d349c1ae2fbb08e9975062/roles/877977a662dd49daab1ee42ba834153e` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:29.082733 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308e4d0-7fd8-464a-8b89-8976ec962ec1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f366603e9ef2405c82fc9fb4c82d1ba0, group_id=0a059e8c76d349c1ae2fbb08e9975062, role_id=877977a662dd49daab1ee42ba834153e)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:29.084214 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308e4d0-7fd8-464a-8b89-8976ec962ec1 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:29.105779 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 211/407] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Sep 23 15:05:28 2022] PUT /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0/groups/0a059e8c76d349c1ae2fbb08e9975062/roles/877977a662dd49daab1ee42ba834153e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:05:29.107461 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308e4d0-7fd8-464a-8b89-8976ec962ec1 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:29.237997 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546c72b-b4a3-4fae-9c08-f1a79549935a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:29.251244 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308e4d0-7fd8-464a-8b89-8976ec962ec1 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:29.289079 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed92c0-274e-462c-8da9-c94f84495120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:29.290155 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed92c0-274e-462c-8da9-c94f84495120 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:29.290658 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed92c0-274e-462c-8da9-c94f84495120 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:29.291119 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed92c0-274e-462c-8da9-c94f84495120 None admin] PATH_INFO: `/v3/groups/0a059e8c76d349c1ae2fbb08e9975062` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:29.292508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed92c0-274e-462c-8da9-c94f84495120 None admin] RBAC: Authorizing `identity:get_group(group_id=0a059e8c76d349c1ae2fbb08e9975062)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:29.294365 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed92c0-274e-462c-8da9-c94f84495120 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:29.296398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 212/408] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 15:05:29 2022] GET /identity/v3/groups/0a059e8c76d349c1ae2fbb08e9975062 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:29.305083 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed92c0-274e-462c-8da9-c94f84495120 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:29.316300 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee06554-6a31-468d-b560-29fb384667b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:29.317343 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee06554-6a31-468d-b560-29fb384667b9 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:29.317863 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee06554-6a31-468d-b560-29fb384667b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:29.318431 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee06554-6a31-468d-b560-29fb384667b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:29.335778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee06554-6a31-468d-b560-29fb384667b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:29.352356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-2ee06554-6a31-468d-b560-29fb384667b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:05:29.352356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:29.352356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:29.352356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:29.352356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:29.352356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:29.352356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:29.352356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:29.352356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:29.352356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:29.352356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:29.352356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:29.352356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:29.352356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:29.352356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:29.352356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:29.353345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:29.353345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:29.353345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:29.353345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:29.353345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:29.353345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:29.353345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:29.353345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:29.353345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:29.353345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:29.353345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:29.353345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:29.353345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:29.353345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:29.353345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:29.353345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:29.354811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:29.354811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:29.354811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:29.354811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:29.354811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:29.354811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:29.354811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:29.354811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:29.354811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:29.354811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:29.354811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:05:29.354811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:29.354811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 197/409] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 15:05:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:29.359536 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee06554-6a31-468d-b560-29fb384667b9 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:29.375033 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:29.391626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:29.442177 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed92c0-274e-462c-8da9-c94f84495120 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:29.465517 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee06554-6a31-468d-b560-29fb384667b9 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:29.486446 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a688a6b-c304-485c-92ef-2e44745a6dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:29.487086 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a688a6b-c304-485c-92ef-2e44745a6dfc None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:29.487446 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a688a6b-c304-485c-92ef-2e44745a6dfc None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:29.487865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a688a6b-c304-485c-92ef-2e44745a6dfc None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:29.489064 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a688a6b-c304-485c-92ef-2e44745a6dfc None admin] RBAC: Authorizing `identity:get_project(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:29.490544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a688a6b-c304-485c-92ef-2e44745a6dfc None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:29.492664 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 213/410] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:29 2022] GET /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:29.498779 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a688a6b-c304-485c-92ef-2e44745a6dfc None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:29.518348 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a9e96-d513-4e9d-b181-7ccb591eae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:29.519279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a9e96-d513-4e9d-b181-7ccb591eae74 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:29.519725 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a9e96-d513-4e9d-b181-7ccb591eae74 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:29.520161 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a9e96-d513-4e9d-b181-7ccb591eae74 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:29.521002 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a9e96-d513-4e9d-b181-7ccb591eae74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:29.521469 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a9e96-d513-4e9d-b181-7ccb591eae74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:29.524257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a9e96-d513-4e9d-b181-7ccb591eae74 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:29.538355 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 198/411] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:29.544001 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a9e96-d513-4e9d-b181-7ccb591eae74 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:29.647387 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a688a6b-c304-485c-92ef-2e44745a6dfc None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:29.678567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:29.681008 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:29.705484 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a9e96-d513-4e9d-b181-7ccb591eae74 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:29.708755 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94636072-907f-4ede-ade3-60b102a303a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:29.709677 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94636072-907f-4ede-ade3-60b102a303a3 None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:29.710171 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94636072-907f-4ede-ade3-60b102a303a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:29.710616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94636072-907f-4ede-ade3-60b102a303a3 None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c/groups/0a059e8c76d349c1ae2fbb08e9975062/roles/877977a662dd49daab1ee42ba834153e` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:29.719001 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94636072-907f-4ede-ade3-60b102a303a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c, group_id=0a059e8c76d349c1ae2fbb08e9975062, role_id=877977a662dd49daab1ee42ba834153e)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:29.720720 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94636072-907f-4ede-ade3-60b102a303a3 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:29.745679 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42d7cd-7127-4142-813f-909aa4e15a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:29.746656 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42d7cd-7127-4142-813f-909aa4e15a37 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:29.747000 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42d7cd-7127-4142-813f-909aa4e15a37 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:29.747342 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42d7cd-7127-4142-813f-909aa4e15a37 None admin] PATH_INFO: `/v3/groups/a5999b6fc50949119f9b2f951bb1f65d` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:29.748635 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42d7cd-7127-4142-813f-909aa4e15a37 None admin] RBAC: Authorizing `identity:get_group(group_id=a5999b6fc50949119f9b2f951bb1f65d)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:29.750231 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42d7cd-7127-4142-813f-909aa4e15a37 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:29.752319 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 199/412] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 15:05:29 2022] GET /identity/v3/groups/a5999b6fc50949119f9b2f951bb1f65d => generated 229 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:29.754364 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 214/413] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Sep 23 15:05:29 2022] PUT /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c/groups/0a059e8c76d349c1ae2fbb08e9975062/roles/877977a662dd49daab1ee42ba834153e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:05:29.757936 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42d7cd-7127-4142-813f-909aa4e15a37 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:29.867829 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42d7cd-7127-4142-813f-909aa4e15a37 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:29.904817 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d89632-bbae-405d-ba3b-b6eae5b9d359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:29.905386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d89632-bbae-405d-ba3b-b6eae5b9d359 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:29.905662 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d89632-bbae-405d-ba3b-b6eae5b9d359 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:29.905969 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d89632-bbae-405d-ba3b-b6eae5b9d359 None admin] PATH_INFO: `/v3/projects/c6971859b35b44e69f745ee34120421d` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:29.907141 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d89632-bbae-405d-ba3b-b6eae5b9d359 None admin] RBAC: Authorizing `identity:get_project(project_id=c6971859b35b44e69f745ee34120421d)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:29.908584 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d89632-bbae-405d-ba3b-b6eae5b9d359 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:29.910600 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 200/414] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:29 2022] GET /identity/v3/projects/c6971859b35b44e69f745ee34120421d => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:29.916513 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94636072-907f-4ede-ade3-60b102a303a3 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:30.052093 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94636072-907f-4ede-ade3-60b102a303a3 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:30.092685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa13c6e-ab47-4f22-b149-c91b1c16718a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:30.093350 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa13c6e-ab47-4f22-b149-c91b1c16718a None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:30.093628 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa13c6e-ab47-4f22-b149-c91b1c16718a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:30.093934 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa13c6e-ab47-4f22-b149-c91b1c16718a None admin] PATH_INFO: `/v3/projects/c6971859b35b44e69f745ee34120421d/groups/a5999b6fc50949119f9b2f951bb1f65d/roles/07d4069c848d4ee9abb586256ee26f20` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:30.095790 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa13c6e-ab47-4f22-b149-c91b1c16718a None admin] RBAC: Authorizing `identity:create_grant(project_id=c6971859b35b44e69f745ee34120421d, group_id=a5999b6fc50949119f9b2f951bb1f65d, role_id=07d4069c848d4ee9abb586256ee26f20)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:30.097226 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa13c6e-ab47-4f22-b149-c91b1c16718a None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:30.113884 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 215/415] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Sep 23 15:05:29 2022] PUT /identity/v3/projects/c6971859b35b44e69f745ee34120421d/groups/a5999b6fc50949119f9b2f951bb1f65d/roles/07d4069c848d4ee9abb586256ee26f20 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:05:30.829012 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714fcf0-64a2-4aeb-b801-dabba7f82fb6 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:30.829758 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714fcf0-64a2-4aeb-b801-dabba7f82fb6 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:30.829758 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714fcf0-64a2-4aeb-b801-dabba7f82fb6 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:30.831149 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 201/416] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:30.836704 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028fed6-060b-4a86-b350-b4afe960b511 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:30.836984 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028fed6-060b-4a86-b350-b4afe960b511 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:30.837257 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028fed6-060b-4a86-b350-b4afe960b511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:30.855997 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-9028fed6-060b-4a86-b350-b4afe960b511 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:30.857552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-9028fed6-060b-4a86-b350-b4afe960b511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:30.908488 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:30.951282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 216/417] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:31.262932 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f3488-28db-47b0-86b9-26e4dc72dedb None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:31.263587 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f3488-28db-47b0-86b9-26e4dc72dedb None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:31.264099 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f3488-28db-47b0-86b9-26e4dc72dedb None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:31.265930 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 202/418] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:31.270787 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1b653-0b02-49e6-a2d8-25670b76915b None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:31.271290 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1b653-0b02-49e6-a2d8-25670b76915b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:31.271756 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1b653-0b02-49e6-a2d8-25670b76915b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:31.298597 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-bfa1b653-0b02-49e6-a2d8-25670b76915b None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:31.300083 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-bfa1b653-0b02-49e6-a2d8-25670b76915b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:31.386249 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 217/419] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:05:31.459214 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f3488-28db-47b0-86b9-26e4dc72dedb None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:31.471506 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:31.576303 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f3488-28db-47b0-86b9-26e4dc72dedb None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:31.611838 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e235cd-3c6a-4609-a956-f8b85ada9051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:31.612826 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e235cd-3c6a-4609-a956-f8b85ada9051 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:31.613296 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e235cd-3c6a-4609-a956-f8b85ada9051 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:31.613813 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e235cd-3c6a-4609-a956-f8b85ada9051 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:31.624519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e235cd-3c6a-4609-a956-f8b85ada9051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:31.630490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-c6e235cd-3c6a-4609-a956-f8b85ada9051 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:31.630490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:31.630490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:31.630490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:31.630490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:31.630490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:31.630490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:31.630490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:31.630490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:31.630490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:31.630490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:31.630490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:31.630490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:31.630490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:31.630490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:31.630490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:31.631361 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:31.631361 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:31.631361 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:31.631361 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:31.631361 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:31.631361 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:31.631361 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:31.631361 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:31.631361 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:31.631361 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:31.631361 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:31.631361 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:31.631361 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:31.631361 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:31.631361 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:31.631361 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:31.632190 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:31.632190 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:31.632190 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:31.632190 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:31.632190 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:31.632190 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:31.632190 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:31.632190 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:31.632190 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:31.632190 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:31.632190 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:31.632190 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:31.634850 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 203/420] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:31.643018 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1b653-0b02-49e6-a2d8-25670b76915b None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:31.779500 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1b653-0b02-49e6-a2d8-25670b76915b None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:31.781150 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:31.821126 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca60fe-1cad-4140-8724-27af90bd5201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:31.821759 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca60fe-1cad-4140-8724-27af90bd5201 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:31.822036 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca60fe-1cad-4140-8724-27af90bd5201 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:31.822300 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca60fe-1cad-4140-8724-27af90bd5201 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:31.822962 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca60fe-1cad-4140-8724-27af90bd5201 None admin] RBAC: Adding query filter params (name=member) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:31.823257 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca60fe-1cad-4140-8724-27af90bd5201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:31.824688 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca60fe-1cad-4140-8724-27af90bd5201 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:31.837140 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 218/421] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:05:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:31.843225 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e235cd-3c6a-4609-a956-f8b85ada9051 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:31.881759 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca60fe-1cad-4140-8724-27af90bd5201 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:31.928994 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:31.963357 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e235cd-3c6a-4609-a956-f8b85ada9051 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:31.997761 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6871d-28f4-4474-9f7d-5d9fd1782cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:31.998743 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6871d-28f4-4474-9f7d-5d9fd1782cbf None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:31.999297 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6871d-28f4-4474-9f7d-5d9fd1782cbf None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:31.999758 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6871d-28f4-4474-9f7d-5d9fd1782cbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:32.049508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca60fe-1cad-4140-8724-27af90bd5201 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:32.086145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6871d-28f4-4474-9f7d-5d9fd1782cbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:32.087921 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6871d-28f4-4474-9f7d-5d9fd1782cbf None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:32.115244 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84ec84-d5ae-41a2-b06f-ecc6530018df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:32.116109 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84ec84-d5ae-41a2-b06f-ecc6530018df None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:32.116480 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84ec84-d5ae-41a2-b06f-ecc6530018df None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:32.116828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84ec84-d5ae-41a2-b06f-ecc6530018df None admin] PATH_INFO: `/v3/roles/member` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:32.134845 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84ec84-d5ae-41a2-b06f-ecc6530018df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:32.149716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-fc84ec84-d5ae-41a2-b06f-ecc6530018df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:32.149716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:32.149716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:32.149716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:32.149716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:32.149716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:32.149716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:32.149716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:32.149716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:32.149716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:32.149716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:32.149716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:32.149716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:32.149716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:32.149716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:32.149716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:32.150601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:32.150601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:32.150601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:32.150601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:32.150601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:32.150601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:32.150601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:32.150601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:32.150601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:32.150601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:32.150601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:32.150601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:32.150601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:32.150601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:32.150601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:32.150601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:32.151399 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:32.151399 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:32.151399 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:32.151399 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:32.151399 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:32.151399 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:32.151399 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:32.151399 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:32.151399 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:32.151399 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:32.151399 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:05:32.151399 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:32.154288 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:32.155087 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 219/422] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:05:32.163847 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84ec84-d5ae-41a2-b06f-ecc6530018df None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:32.196803 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 204/423] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:32.202775 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6871d-28f4-4474-9f7d-5d9fd1782cbf None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:32.244072 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:32.316241 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6871d-28f4-4474-9f7d-5d9fd1782cbf None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:32.351399 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84ec84-d5ae-41a2-b06f-ecc6530018df None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:32.358241 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04149889-6548-4dc8-ac04-47b1134f18f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:32.359022 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04149889-6548-4dc8-ac04-47b1134f18f8 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:32.359392 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04149889-6548-4dc8-ac04-47b1134f18f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:32.359757 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04149889-6548-4dc8-ac04-47b1134f18f8 None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:32.361373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04149889-6548-4dc8-ac04-47b1134f18f8 None admin] RBAC: Authorizing `identity:get_project(project_id=f366603e9ef2405c82fc9fb4c82d1ba0)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:32.363316 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04149889-6548-4dc8-ac04-47b1134f18f8 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:32.369726 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 205/424] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:32 2022] GET /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:32.369726 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b27a71-1e6a-4b3e-8738-e2fdde06c31e None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:32.369726 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b27a71-1e6a-4b3e-8738-e2fdde06c31e None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:32.369726 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b27a71-1e6a-4b3e-8738-e2fdde06c31e None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:32.369726 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 206/425] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:32.375311 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b27a71-1e6a-4b3e-8738-e2fdde06c31e None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:32.399666 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e29c0-4b08-4649-8c7d-a8276b173b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:32.400651 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e29c0-4b08-4649-8c7d-a8276b173b6b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:32.401613 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e29c0-4b08-4649-8c7d-a8276b173b6b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:32.402109 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e29c0-4b08-4649-8c7d-a8276b173b6b None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:32.403302 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e29c0-4b08-4649-8c7d-a8276b173b6b None admin] RBAC: Adding query filter params (name=member) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:32.404016 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e29c0-4b08-4649-8c7d-a8276b173b6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:32.406287 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e29c0-4b08-4649-8c7d-a8276b173b6b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:32.417746 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:32.418686 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 220/426] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:05:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:32.420006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fbba1-99a9-4e98-90fd-3e44906b3179 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:32.426228 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fbba1-99a9-4e98-90fd-3e44906b3179 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:32.426827 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fbba1-99a9-4e98-90fd-3e44906b3179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:32.452541 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-584fbba1-99a9-4e98-90fd-3e44906b3179 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:32.454925 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-584fbba1-99a9-4e98-90fd-3e44906b3179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:32.504914 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b27a71-1e6a-4b3e-8738-e2fdde06c31e None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:32.541304 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9eaf9-2210-4c9e-96a6-65145cb20815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:32.541997 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9eaf9-2210-4c9e-96a6-65145cb20815 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:32.542253 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9eaf9-2210-4c9e-96a6-65145cb20815 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:32.542520 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9eaf9-2210-4c9e-96a6-65145cb20815 None admin] PATH_INFO: `/v3/groups/0a059e8c76d349c1ae2fbb08e9975062` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:32.543727 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9eaf9-2210-4c9e-96a6-65145cb20815 None admin] RBAC: Authorizing `identity:get_group(group_id=0a059e8c76d349c1ae2fbb08e9975062)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:32.545452 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9eaf9-2210-4c9e-96a6-65145cb20815 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:32.552300 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 207/427] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 15:05:32 2022] GET /identity/v3/groups/0a059e8c76d349c1ae2fbb08e9975062 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:32.552300 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9eaf9-2210-4c9e-96a6-65145cb20815 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:32.557630 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 221/428] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:32.558991 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fbba1-99a9-4e98-90fd-3e44906b3179 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:32.580433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:32.677204 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fbba1-99a9-4e98-90fd-3e44906b3179 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:32.729601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b56f1-df3b-4487-95b7-398d536eb822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:32.730606 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b56f1-df3b-4487-95b7-398d536eb822 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:32.731064 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b56f1-df3b-4487-95b7-398d536eb822 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:32.731809 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b56f1-df3b-4487-95b7-398d536eb822 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:32.732938 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b56f1-df3b-4487-95b7-398d536eb822 None admin] RBAC: Adding query filter params (group.id=0a059e8c76d349c1ae2fbb08e9975062, role.id=dfd00108a3dd42f1a9dd0335f4b8f508, scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:32.733408 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b56f1-df3b-4487-95b7-398d536eb822 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:32.735524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b56f1-df3b-4487-95b7-398d536eb822 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:32.742447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 222/429] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Sep 23 15:05:32 2022] GET /identity/v3/role_assignments?group.id=0a059e8c76d349c1ae2fbb08e9975062&scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0&role.id=dfd00108a3dd42f1a9dd0335f4b8f508 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:32.798151 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9eaf9-2210-4c9e-96a6-65145cb20815 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:32.807968 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:32.862458 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c676f0-55fe-4f77-b649-719e53aac03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:32.863087 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c676f0-55fe-4f77-b649-719e53aac03a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:32.863358 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c676f0-55fe-4f77-b649-719e53aac03a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:32.863623 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c676f0-55fe-4f77-b649-719e53aac03a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:32.867605 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997578ec-1a72-4f35-b2b9-345c33c4cea9 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:32.867884 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997578ec-1a72-4f35-b2b9-345c33c4cea9 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:32.868161 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997578ec-1a72-4f35-b2b9-345c33c4cea9 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:32.869794 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 223/430] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:05:32.879144 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15a22a-34ae-4f2e-8dda-35485fff059c None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:32.879451 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15a22a-34ae-4f2e-8dda-35485fff059c None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:32.879688 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15a22a-34ae-4f2e-8dda-35485fff059c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:32.918901 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-2e15a22a-34ae-4f2e-8dda-35485fff059c None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:32.920117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-2e15a22a-34ae-4f2e-8dda-35485fff059c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:32.959794 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c676f0-55fe-4f77-b649-719e53aac03a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:32.961994 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c676f0-55fe-4f77-b649-719e53aac03a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:33.012761 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 224/431] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:33.013650 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15a22a-34ae-4f2e-8dda-35485fff059c None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:33.028554 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:33.085862 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 208/432] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:33.093442 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c676f0-55fe-4f77-b649-719e53aac03a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:33.097531 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:33.160975 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15a22a-34ae-4f2e-8dda-35485fff059c None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:33.202848 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d081de-d5c3-4a4b-b69e-ac5c71241f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:33.203475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d081de-d5c3-4a4b-b69e-ac5c71241f1e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:33.203774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d081de-d5c3-4a4b-b69e-ac5c71241f1e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:33.204039 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d081de-d5c3-4a4b-b69e-ac5c71241f1e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:33.218268 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d081de-d5c3-4a4b-b69e-ac5c71241f1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:33.222984 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-d0d081de-d5c3-4a4b-b69e-ac5c71241f1e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:05:33.222984 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:33.222984 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:33.222984 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:33.222984 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:33.222984 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:33.222984 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:33.222984 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:33.222984 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:33.222984 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:33.222984 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:33.222984 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:33.222984 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:33.222984 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:33.222984 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:33.222984 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:33.224091 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:33.224091 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:33.224091 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:33.224091 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:33.224091 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:33.224091 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:33.224091 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:33.224091 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:33.224091 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:33.224091 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:33.224091 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:33.224091 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:33.224091 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:33.224091 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:33.224091 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:33.224091 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:33.224941 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:33.224941 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:33.224941 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:33.224941 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:33.224941 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:33.224941 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:33.224941 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:33.224941 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:33.224941 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:33.224941 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:33.224941 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:05:33.224941 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:33.225585 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c676f0-55fe-4f77-b649-719e53aac03a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:33.225666 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 225/433] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 15:05:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:33.225666 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8335c6f-a6bd-4736-ad78-79285a7a8370 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:33.225666 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8335c6f-a6bd-4736-ad78-79285a7a8370 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:33.225860 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8335c6f-a6bd-4736-ad78-79285a7a8370 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:33.227778 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 226/434] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:33.234751 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8335c6f-a6bd-4736-ad78-79285a7a8370 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:33.267541 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d77bc-a2b9-4155-a3b3-8dbae8c90754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:33.268188 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d77bc-a2b9-4155-a3b3-8dbae8c90754 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:33.268461 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d77bc-a2b9-4155-a3b3-8dbae8c90754 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:33.268734 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d77bc-a2b9-4155-a3b3-8dbae8c90754 None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:33.270575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d77bc-a2b9-4155-a3b3-8dbae8c90754 None admin] RBAC: Authorizing `identity:get_project(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:33.271346 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d77bc-a2b9-4155-a3b3-8dbae8c90754 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:33.273739 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 209/435] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:33 2022] GET /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:33.274490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9028b-c914-416d-88ad-b4f9648ed4de None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:33.274771 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9028b-c914-416d-88ad-b4f9648ed4de None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:33.275044 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9028b-c914-416d-88ad-b4f9648ed4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:33.299658 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-57c9028b-c914-416d-88ad-b4f9648ed4de None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:33.300858 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-57c9028b-c914-416d-88ad-b4f9648ed4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:33.339627 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:33.380493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 210/436] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:33.381365 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9028b-c914-416d-88ad-b4f9648ed4de None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:33.382893 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8335c6f-a6bd-4736-ad78-79285a7a8370 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:33.383625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:33.420987 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e9eb9-accd-4104-ae35-81ed0f55696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:33.421893 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e9eb9-accd-4104-ae35-81ed0f55696f None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:33.422165 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e9eb9-accd-4104-ae35-81ed0f55696f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:33.422429 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e9eb9-accd-4104-ae35-81ed0f55696f None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:33.423279 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e9eb9-accd-4104-ae35-81ed0f55696f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:33.423398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e9eb9-accd-4104-ae35-81ed0f55696f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:33.424708 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e9eb9-accd-4104-ae35-81ed0f55696f None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:33.437182 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 227/437] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:05:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:33.437182 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e9eb9-accd-4104-ae35-81ed0f55696f None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:33.488935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9028b-c914-416d-88ad-b4f9648ed4de None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:33.523094 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73db7f-759b-46ab-9f77-b22d957324b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:33.523819 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73db7f-759b-46ab-9f77-b22d957324b6 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:33.524093 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73db7f-759b-46ab-9f77-b22d957324b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:33.524368 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73db7f-759b-46ab-9f77-b22d957324b6 None admin] PATH_INFO: `/v3/groups/0a059e8c76d349c1ae2fbb08e9975062` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:33.525467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73db7f-759b-46ab-9f77-b22d957324b6 None admin] RBAC: Authorizing `identity:get_group(group_id=0a059e8c76d349c1ae2fbb08e9975062)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:33.526979 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73db7f-759b-46ab-9f77-b22d957324b6 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:33.528840 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 211/438] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 15:05:33 2022] GET /identity/v3/groups/0a059e8c76d349c1ae2fbb08e9975062 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:33.529655 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73db7f-759b-46ab-9f77-b22d957324b6 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:33.541315 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e9eb9-accd-4104-ae35-81ed0f55696f None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:33.571264 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:33.577520 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40d064-401b-4c8b-917a-a011e383234b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:33.578498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40d064-401b-4c8b-917a-a011e383234b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:33.579117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40d064-401b-4c8b-917a-a011e383234b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:33.579558 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40d064-401b-4c8b-917a-a011e383234b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:33.590499 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40d064-401b-4c8b-917a-a011e383234b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:33.596394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-8b40d064-401b-4c8b-917a-a011e383234b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:05:33.596394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:33.596394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:33.596394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:33.596394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:33.596394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:33.596394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:33.596394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:33.596394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:33.596394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:33.596394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:33.596394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:33.596394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:33.596394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:33.596394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:33.596394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:33.597360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:33.597360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:33.597360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:33.597360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:33.597360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:33.597360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:33.597360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:33.597360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:33.597360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:33.597360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:33.597360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:33.597360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:33.597360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:33.597360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:33.597360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:33.597360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:33.598255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:33.598255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:33.598255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:33.598255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:33.598255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:33.598255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:33.598255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:33.598255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:33.598255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:33.598255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:33.598255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:05:33.598255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:33.598890 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:33.600092 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 228/439] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 15:05:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:33.601041 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40d064-401b-4c8b-917a-a011e383234b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:33.636827 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73db7f-759b-46ab-9f77-b22d957324b6 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:33.671068 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dc1b1-a946-41fa-b8c0-aec37c86e925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:33.671697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dc1b1-a946-41fa-b8c0-aec37c86e925 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:33.671974 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dc1b1-a946-41fa-b8c0-aec37c86e925 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:33.672231 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dc1b1-a946-41fa-b8c0-aec37c86e925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:33.704554 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40d064-401b-4c8b-917a-a011e383234b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:33.738275 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e030680-8669-413f-9af2-0ab485f3de63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:33.738882 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e030680-8669-413f-9af2-0ab485f3de63 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:33.739227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e030680-8669-413f-9af2-0ab485f3de63 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:33.739433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e030680-8669-413f-9af2-0ab485f3de63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:33.740173 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e030680-8669-413f-9af2-0ab485f3de63 None admin] RBAC: Adding query filter params (group.id=0a059e8c76d349c1ae2fbb08e9975062, role.id=dfd00108a3dd42f1a9dd0335f4b8f508, scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:33.740475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e030680-8669-413f-9af2-0ab485f3de63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:33.740568 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dc1b1-a946-41fa-b8c0-aec37c86e925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:33.741941 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e030680-8669-413f-9af2-0ab485f3de63 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:33.742034 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dc1b1-a946-41fa-b8c0-aec37c86e925 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:33.748183 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 229/440] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Sep 23 15:05:33 2022] GET /identity/v3/role_assignments?group.id=0a059e8c76d349c1ae2fbb08e9975062&scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c&role.id=dfd00108a3dd42f1a9dd0335f4b8f508 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:33.748948 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e030680-8669-413f-9af2-0ab485f3de63 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:33.818018 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:33.822681 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:33.857886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 212/441] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:33.859284 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dc1b1-a946-41fa-b8c0-aec37c86e925 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:33.875631 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e030680-8669-413f-9af2-0ab485f3de63 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:33.909925 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24f8d5-9ef7-411b-87b7-f51370467be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:33.910542 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24f8d5-9ef7-411b-87b7-f51370467be0 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:33.910814 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24f8d5-9ef7-411b-87b7-f51370467be0 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:33.911079 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24f8d5-9ef7-411b-87b7-f51370467be0 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:33.911733 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24f8d5-9ef7-411b-87b7-f51370467be0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:33.912026 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24f8d5-9ef7-411b-87b7-f51370467be0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:33.913405 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24f8d5-9ef7-411b-87b7-f51370467be0 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:33.923356 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 230/442] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:05:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:33.924382 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24f8d5-9ef7-411b-87b7-f51370467be0 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:33.979439 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dc1b1-a946-41fa-b8c0-aec37c86e925 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:34.026870 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4469fa8-26ee-4335-8a97-03e436522c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:34.027448 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4469fa8-26ee-4335-8a97-03e436522c19 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:34.027724 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4469fa8-26ee-4335-8a97-03e436522c19 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:34.027993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4469fa8-26ee-4335-8a97-03e436522c19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:34.038015 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4469fa8-26ee-4335-8a97-03e436522c19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:34.043220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-e4469fa8-26ee-4335-8a97-03e436522c19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:05:34.043220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:34.043220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:34.043220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:34.043220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:34.043220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:34.043220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:34.043220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:34.043220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:34.043220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:34.043220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:34.043220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:34.043220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:34.043220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:34.043220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:34.043220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:34.044272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:34.044272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:34.044272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:34.044272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:34.044272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:34.044272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:34.044272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:34.044272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:34.044272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:34.044272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:34.044272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:34.044272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:34.044272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:34.044272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:34.044272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:34.044272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:34.045465 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:34.045465 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:34.045465 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:34.045465 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:34.045465 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:34.045465 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:34.045465 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:34.045465 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:34.045465 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:34.045465 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:34.045465 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:05:34.045465 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:34.045465 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 213/443] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 15:05:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:34.045465 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4469fa8-26ee-4335-8a97-03e436522c19 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:34.049288 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24f8d5-9ef7-411b-87b7-f51370467be0 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:34.066480 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:34.076278 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:34.084473 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff9059-a492-4d2c-a6ca-d94d6900f7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:34.085082 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff9059-a492-4d2c-a6ca-d94d6900f7d0 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:34.085358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff9059-a492-4d2c-a6ca-d94d6900f7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:34.085626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff9059-a492-4d2c-a6ca-d94d6900f7d0 None admin] PATH_INFO: `/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:34.086825 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff9059-a492-4d2c-a6ca-d94d6900f7d0 None admin] RBAC: Authorizing `identity:get_project(project_id=f366603e9ef2405c82fc9fb4c82d1ba0)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:34.088295 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff9059-a492-4d2c-a6ca-d94d6900f7d0 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:34.089929 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 231/444] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:33 2022] GET /identity/v3/projects/f366603e9ef2405c82fc9fb4c82d1ba0 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:34.090678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff9059-a492-4d2c-a6ca-d94d6900f7d0 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:34.147734 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4469fa8-26ee-4335-8a97-03e436522c19 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:34.181216 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9276b-dcb9-4104-ac9d-ba8a09da1a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:34.181898 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9276b-dcb9-4104-ac9d-ba8a09da1a25 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:34.182168 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9276b-dcb9-4104-ac9d-ba8a09da1a25 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:34.182436 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9276b-dcb9-4104-ac9d-ba8a09da1a25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:34.187916 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff9059-a492-4d2c-a6ca-d94d6900f7d0 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:34.220147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63820cb7-3121-4efa-92ae-a9401526751e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:34.220774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63820cb7-3121-4efa-92ae-a9401526751e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:34.221046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63820cb7-3121-4efa-92ae-a9401526751e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:34.221313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63820cb7-3121-4efa-92ae-a9401526751e None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:34.221954 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63820cb7-3121-4efa-92ae-a9401526751e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:34.222250 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63820cb7-3121-4efa-92ae-a9401526751e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:34.223706 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63820cb7-3121-4efa-92ae-a9401526751e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:34.231757 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 232/445] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:34.232519 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63820cb7-3121-4efa-92ae-a9401526751e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:34.252570 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9276b-dcb9-4104-ac9d-ba8a09da1a25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:34.254103 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9276b-dcb9-4104-ac9d-ba8a09da1a25 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:34.281881 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:34.282974 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:34.340362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63820cb7-3121-4efa-92ae-a9401526751e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:34.356870 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 214/446] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:34.357744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9276b-dcb9-4104-ac9d-ba8a09da1a25 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:34.375953 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5c4b4-3812-4c96-8cb6-5332d84a2afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:34.376865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5c4b4-3812-4c96-8cb6-5332d84a2afa None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:34.377143 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5c4b4-3812-4c96-8cb6-5332d84a2afa None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:34.377411 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5c4b4-3812-4c96-8cb6-5332d84a2afa None admin] PATH_INFO: `/v3/groups/0a059e8c76d349c1ae2fbb08e9975062` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:34.378620 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5c4b4-3812-4c96-8cb6-5332d84a2afa None admin] RBAC: Authorizing `identity:get_group(group_id=0a059e8c76d349c1ae2fbb08e9975062)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:34.380047 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5c4b4-3812-4c96-8cb6-5332d84a2afa None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:34.381625 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 233/447] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 15:05:34 2022] GET /identity/v3/groups/0a059e8c76d349c1ae2fbb08e9975062 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:34.382401 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5c4b4-3812-4c96-8cb6-5332d84a2afa None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:34.462106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9276b-dcb9-4104-ac9d-ba8a09da1a25 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:34.477244 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5c4b4-3812-4c96-8cb6-5332d84a2afa None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:34.489952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:34.494099 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:34.497147 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca744749-6630-4782-a6f6-c96d8d4067b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:34.497799 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca744749-6630-4782-a6f6-c96d8d4067b7 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:34.498078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca744749-6630-4782-a6f6-c96d8d4067b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:34.498366 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca744749-6630-4782-a6f6-c96d8d4067b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:34.512289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70135db3-5aaa-4b6d-9874-29c3b77015ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:34.512926 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70135db3-5aaa-4b6d-9874-29c3b77015ee None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:34.513202 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70135db3-5aaa-4b6d-9874-29c3b77015ee None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:34.513459 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70135db3-5aaa-4b6d-9874-29c3b77015ee None admin] PATH_INFO: `/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:34.514605 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70135db3-5aaa-4b6d-9874-29c3b77015ee None admin] RBAC: Authorizing `identity:get_project(project_id=c861a3a5cd89449bb3c4cd8d9ce3e02c)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:34.516074 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70135db3-5aaa-4b6d-9874-29c3b77015ee None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:34.517904 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 234/448] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:34 2022] GET /identity/v3/projects/c861a3a5cd89449bb3c4cd8d9ce3e02c => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:34.518478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70135db3-5aaa-4b6d-9874-29c3b77015ee None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:34.564263 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca744749-6630-4782-a6f6-c96d8d4067b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:34.565717 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca744749-6630-4782-a6f6-c96d8d4067b7 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:34.614144 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70135db3-5aaa-4b6d-9874-29c3b77015ee None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:34.646455 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c062eb-6ad0-48f9-9cee-b03a756273c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:34.647279 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c062eb-6ad0-48f9-9cee-b03a756273c2 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:34.647547 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c062eb-6ad0-48f9-9cee-b03a756273c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:34.647814 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c062eb-6ad0-48f9-9cee-b03a756273c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:34.648519 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c062eb-6ad0-48f9-9cee-b03a756273c2 None admin] RBAC: Adding query filter params (group.id=0a059e8c76d349c1ae2fbb08e9975062, role.id=877977a662dd49daab1ee42ba834153e, scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:34.648853 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c062eb-6ad0-48f9-9cee-b03a756273c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:34.650312 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c062eb-6ad0-48f9-9cee-b03a756273c2 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:34.665843 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 235/449] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Sep 23 15:05:34 2022] GET /identity/v3/role_assignments?group.id=0a059e8c76d349c1ae2fbb08e9975062&scope.project.id=f366603e9ef2405c82fc9fb4c82d1ba0&role.id=877977a662dd49daab1ee42ba834153e => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:34.665843 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c062eb-6ad0-48f9-9cee-b03a756273c2 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:34.667281 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 215/450] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:34.673000 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca744749-6630-4782-a6f6-c96d8d4067b7 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:34.709197 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:34.726107 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:34.781147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c062eb-6ad0-48f9-9cee-b03a756273c2 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:34.795441 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca744749-6630-4782-a6f6-c96d8d4067b7 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:34.821556 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ffb21-8bde-4e11-aa2d-cb0db4889c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:34.822136 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ffb21-8bde-4e11-aa2d-cb0db4889c68 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:34.822408 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ffb21-8bde-4e11-aa2d-cb0db4889c68 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:34.822675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ffb21-8bde-4e11-aa2d-cb0db4889c68 None admin] PATH_INFO: `/v3/groups/0a059e8c76d349c1ae2fbb08e9975062` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:34.823820 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ffb21-8bde-4e11-aa2d-cb0db4889c68 None admin] RBAC: Authorizing `identity:get_group(group_id=0a059e8c76d349c1ae2fbb08e9975062)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:34.825410 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ffb21-8bde-4e11-aa2d-cb0db4889c68 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:34.827143 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 236/451] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 15:05:34 2022] GET /identity/v3/groups/0a059e8c76d349c1ae2fbb08e9975062 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:34.833042 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ffb21-8bde-4e11-aa2d-cb0db4889c68 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:34.838257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c84ac-c1c7-4ea5-a8d9-8828f80c348a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:34.838910 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c84ac-c1c7-4ea5-a8d9-8828f80c348a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:34.839183 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c84ac-c1c7-4ea5-a8d9-8828f80c348a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:34.839448 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c84ac-c1c7-4ea5-a8d9-8828f80c348a None admin] PATH_INFO: `/v3/projects/c6971859b35b44e69f745ee34120421d` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:34.840632 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c84ac-c1c7-4ea5-a8d9-8828f80c348a None admin] RBAC: Authorizing `identity:get_project(project_id=c6971859b35b44e69f745ee34120421d)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:34.842157 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c84ac-c1c7-4ea5-a8d9-8828f80c348a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:34.843998 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 216/452] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 15:05:34 2022] GET /identity/v3/projects/c6971859b35b44e69f745ee34120421d => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:34.849649 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c84ac-c1c7-4ea5-a8d9-8828f80c348a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:34.954455 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ffb21-8bde-4e11-aa2d-cb0db4889c68 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:34.967601 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:34.972834 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c84ac-c1c7-4ea5-a8d9-8828f80c348a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:34.973438 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:35.000255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016d8dc-fcf2-440c-a3bb-dcc3dc198a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:35.000862 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016d8dc-fcf2-440c-a3bb-dcc3dc198a87 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:35.001143 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016d8dc-fcf2-440c-a3bb-dcc3dc198a87 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:35.001414 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016d8dc-fcf2-440c-a3bb-dcc3dc198a87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:35.002213 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016d8dc-fcf2-440c-a3bb-dcc3dc198a87 None admin] RBAC: Adding query filter params (group.id=0a059e8c76d349c1ae2fbb08e9975062, role.id=877977a662dd49daab1ee42ba834153e, scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:35.002524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016d8dc-fcf2-440c-a3bb-dcc3dc198a87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:35.003977 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016d8dc-fcf2-440c-a3bb-dcc3dc198a87 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:35.009995 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 237/453] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Sep 23 15:05:34 2022] GET /identity/v3/role_assignments?group.id=0a059e8c76d349c1ae2fbb08e9975062&scope.project.id=c861a3a5cd89449bb3c4cd8d9ce3e02c&role.id=877977a662dd49daab1ee42ba834153e => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:35.011141 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c30e23-1003-435d-a280-d9f2954a8023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:35.011834 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c30e23-1003-435d-a280-d9f2954a8023 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:35.012110 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c30e23-1003-435d-a280-d9f2954a8023 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:35.012378 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c30e23-1003-435d-a280-d9f2954a8023 None admin] PATH_INFO: `/v3/groups/a5999b6fc50949119f9b2f951bb1f65d` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:35.013504 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c30e23-1003-435d-a280-d9f2954a8023 None admin] RBAC: Authorizing `identity:get_group(group_id=a5999b6fc50949119f9b2f951bb1f65d)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:35.014976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c30e23-1003-435d-a280-d9f2954a8023 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:35.016588 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 217/454] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 15:05:34 2022] GET /identity/v3/groups/a5999b6fc50949119f9b2f951bb1f65d => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:35.022999 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016d8dc-fcf2-440c-a3bb-dcc3dc198a87 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:35.136632 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016d8dc-fcf2-440c-a3bb-dcc3dc198a87 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:35.171909 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c7cb6-ba2b-4b96-a39c-e3a98bfc62a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:35.172520 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c7cb6-ba2b-4b96-a39c-e3a98bfc62a2 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:35.172789 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c7cb6-ba2b-4b96-a39c-e3a98bfc62a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:35.173052 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c7cb6-ba2b-4b96-a39c-e3a98bfc62a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:35.173811 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c7cb6-ba2b-4b96-a39c-e3a98bfc62a2 None admin] RBAC: Adding query filter params (group.id=a5999b6fc50949119f9b2f951bb1f65d, role.id=07d4069c848d4ee9abb586256ee26f20, scope.project.id=c6971859b35b44e69f745ee34120421d) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:35.174109 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c7cb6-ba2b-4b96-a39c-e3a98bfc62a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:35.175598 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c7cb6-ba2b-4b96-a39c-e3a98bfc62a2 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:35.182440 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 238/455] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Sep 23 15:05:35 2022] GET /identity/v3/role_assignments?group.id=a5999b6fc50949119f9b2f951bb1f65d&scope.project.id=c6971859b35b44e69f745ee34120421d&role.id=07d4069c848d4ee9abb586256ee26f20 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:37.887456 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b5ed6-2d7e-478f-9da6-a29ae53b348a None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:37.887998 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b5ed6-2d7e-478f-9da6-a29ae53b348a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:37.888118 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b5ed6-2d7e-478f-9da6-a29ae53b348a None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:37.890215 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 218/456] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:37.895627 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcfc60-ee4a-46da-a164-ca2c9904cc7f None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:37.896454 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcfc60-ee4a-46da-a164-ca2c9904cc7f None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:37.897093 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcfc60-ee4a-46da-a164-ca2c9904cc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:37.916155 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-e7fcfc60-ee4a-46da-a164-ca2c9904cc7f None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:37.917839 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-e7fcfc60-ee4a-46da-a164-ca2c9904cc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:37.958716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:37.990026 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 239/457] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:38.018305 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a6039-c9d0-4eac-80d8-d3ded4ffdb8c None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:38.018906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a6039-c9d0-4eac-80d8-d3ded4ffdb8c None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:38.019377 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a6039-c9d0-4eac-80d8-d3ded4ffdb8c None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:38.021214 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 219/458] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:38.026672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf0c26-f2fa-4f3d-87f0-5b506f248eb9 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:38.026951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf0c26-f2fa-4f3d-87f0-5b506f248eb9 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:38.027218 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf0c26-f2fa-4f3d-87f0-5b506f248eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:38.045518 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-f0cf0c26-f2fa-4f3d-87f0-5b506f248eb9 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:38.046716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-f0cf0c26-f2fa-4f3d-87f0-5b506f248eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:38.118688 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 240/459] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:38.173323 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c6f5e-8e8d-4b0e-a529-bb66de8d73f5 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:38.173630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c6f5e-8e8d-4b0e-a529-bb66de8d73f5 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:38.173900 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c6f5e-8e8d-4b0e-a529-bb66de8d73f5 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:38.175498 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 220/460] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:38.180644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58845dab-2960-4485-9ce6-cb220c910830 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:38.180925 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58845dab-2960-4485-9ce6-cb220c910830 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:38.181198 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58845dab-2960-4485-9ce6-cb220c910830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:38.200837 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-58845dab-2960-4485-9ce6-cb220c910830 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:38.202069 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-58845dab-2960-4485-9ce6-cb220c910830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:38.272828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 241/461] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:38.314178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c6f5e-8e8d-4b0e-a529-bb66de8d73f5 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:38.418242 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c6f5e-8e8d-4b0e-a529-bb66de8d73f5 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:38.441954 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58845dab-2960-4485-9ce6-cb220c910830 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:38.460055 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaf4d1-0589-48de-8e8d-403fa59b9e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:38.460696 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaf4d1-0589-48de-8e8d-403fa59b9e91 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:38.460973 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaf4d1-0589-48de-8e8d-403fa59b9e91 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:38.461281 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaf4d1-0589-48de-8e8d-403fa59b9e91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:38.474345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaf4d1-0589-48de-8e8d-403fa59b9e91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:38.476591 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaf4d1-0589-48de-8e8d-403fa59b9e91 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:38.480192 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:38.495209 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-64aaf4d1-0589-48de-8e8d-403fa59b9e91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:38.495209 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:38.495209 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:38.495209 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:38.495209 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:38.495209 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:38.495209 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:38.495209 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:38.495209 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:38.495209 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:38.495209 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:38.495209 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:38.495209 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:38.495209 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:38.495209 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:38.495209 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:38.496146 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:38.496146 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:38.496146 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:38.496146 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:38.496146 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:38.496146 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:38.496146 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:38.496146 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:38.496146 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:38.496146 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:38.496146 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:38.496146 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:38.496146 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:38.496146 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:38.496146 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:38.496146 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:38.496146 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:38.497029 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:38.497029 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:38.497029 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:38.497194 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 221/462] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:38.502608 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaf4d1-0589-48de-8e8d-403fa59b9e91 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:38.523562 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:38.551265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58845dab-2960-4485-9ce6-cb220c910830 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:38.592320 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f00d2-e2a3-492f-b729-ea136b258211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:38.592958 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f00d2-e2a3-492f-b729-ea136b258211 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:38.593231 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f00d2-e2a3-492f-b729-ea136b258211 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:38.593525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f00d2-e2a3-492f-b729-ea136b258211 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:38.603913 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f00d2-e2a3-492f-b729-ea136b258211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:38.605359 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f00d2-e2a3-492f-b729-ea136b258211 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:38.610415 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaf4d1-0589-48de-8e8d-403fa59b9e91 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:38.620233 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-817f00d2-e2a3-492f-b729-ea136b258211 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:38.620233 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:38.620233 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:38.620233 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:38.620233 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:38.620233 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:38.620233 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:38.620233 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:38.620233 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:38.620233 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:38.620233 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:38.620233 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:38.620233 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:38.620233 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:38.620233 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:38.620233 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:38.621276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:38.621276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:38.621276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:38.621276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:38.621276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:38.621276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:38.621276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:38.621276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:38.621276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:38.621276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:38.621276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:38.621276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:38.621276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:38.621276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:38.621276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:38.621276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:38.621276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:38.622178 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:38.622178 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:38.622178 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:38.622178 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 242/463] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:38.622480 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207855-3a1e-4148-bdab-6f461f1d51b3 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:38.622750 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207855-3a1e-4148-bdab-6f461f1d51b3 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:38.623023 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207855-3a1e-4148-bdab-6f461f1d51b3 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:38.624226 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 243/464] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:38.624899 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a207855-3a1e-4148-bdab-6f461f1d51b3 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:38.647633 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfc99e-9bf7-4f8d-bfb7-2b92ee85d3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:38.648242 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfc99e-9bf7-4f8d-bfb7-2b92ee85d3df None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:38.648539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfc99e-9bf7-4f8d-bfb7-2b92ee85d3df None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:38.648816 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfc99e-9bf7-4f8d-bfb7-2b92ee85d3df None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:38.649457 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfc99e-9bf7-4f8d-bfb7-2b92ee85d3df None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:38.649785 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfc99e-9bf7-4f8d-bfb7-2b92ee85d3df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:38.651165 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfc99e-9bf7-4f8d-bfb7-2b92ee85d3df None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:38.669314 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 222/465] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:38.670426 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfc99e-9bf7-4f8d-bfb7-2b92ee85d3df None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:38.712281 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:38.729533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a207855-3a1e-4148-bdab-6f461f1d51b3 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:38.751000 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:38.763861 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c828f7-747d-4cd1-b397-035213167a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:38.764481 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c828f7-747d-4cd1-b397-035213167a72 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:38.764748 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c828f7-747d-4cd1-b397-035213167a72 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:38.765013 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c828f7-747d-4cd1-b397-035213167a72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:38.772372 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfc99e-9bf7-4f8d-bfb7-2b92ee85d3df None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:38.775359 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c828f7-747d-4cd1-b397-035213167a72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:38.776729 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c828f7-747d-4cd1-b397-035213167a72 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:38.790419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-21c828f7-747d-4cd1-b397-035213167a72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:38.790419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:38.790419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:38.790419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:38.790419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:38.790419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:38.790419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:38.790419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:38.790419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:38.790419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:38.790419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:38.790419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:38.790419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:38.790419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:38.790419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:38.790419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:38.791522 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:38.791522 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:38.791522 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:38.791522 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:38.791522 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:38.791522 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:38.791522 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:38.791522 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:38.791522 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:38.791522 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:38.791522 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:38.791522 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:38.791522 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:38.791522 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:38.791522 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:38.791522 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:38.791522 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:38.792410 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:38.792410 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:38.792410 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:38.792410 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 244/466] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:38.793009 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3e7e7-d3b6-4d2a-8d92-f18f10d83845 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:38.793294 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3e7e7-d3b6-4d2a-8d92-f18f10d83845 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:38.793577 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3e7e7-d3b6-4d2a-8d92-f18f10d83845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:38.808022 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbf231-67f9-4933-99f4-c2415a359172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:38.808637 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbf231-67f9-4933-99f4-c2415a359172 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:38.808912 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbf231-67f9-4933-99f4-c2415a359172 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:38.809178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbf231-67f9-4933-99f4-c2415a359172 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:38.809856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abbf231-67f9-4933-99f4-c2415a359172 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:38.810146 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abbf231-67f9-4933-99f4-c2415a359172 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:38.811083 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-c8b3e7e7-d3b6-4d2a-8d92-f18f10d83845 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:38.811835 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abbf231-67f9-4933-99f4-c2415a359172 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:38.812250 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-c8b3e7e7-d3b6-4d2a-8d92-f18f10d83845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:38.823752 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 223/467] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:38.824510 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbf231-67f9-4933-99f4-c2415a359172 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:38.889721 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 245/468] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:38.889721 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3e7e7-d3b6-4d2a-8d92-f18f10d83845 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:38.932644 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbf231-67f9-4933-99f4-c2415a359172 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:38.955249 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:38.967507 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e842ff4-1256-497e-9b32-651d91488ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:38.968218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e842ff4-1256-497e-9b32-651d91488ca5 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:38.968493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e842ff4-1256-497e-9b32-651d91488ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:38.968754 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e842ff4-1256-497e-9b32-651d91488ca5 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:38.969396 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e842ff4-1256-497e-9b32-651d91488ca5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:38.970976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e842ff4-1256-497e-9b32-651d91488ca5 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:38.981878 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:38.990503 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3e7e7-d3b6-4d2a-8d92-f18f10d83845 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:39.006004 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 224/469] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 15:05:38 2022] POST /identity/v3/users => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:05:39.007041 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e842ff4-1256-497e-9b32-651d91488ca5 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:39.033951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51279518-a517-43d5-97bc-ae373c8057ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:39.034943 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51279518-a517-43d5-97bc-ae373c8057ff None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:39.035453 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51279518-a517-43d5-97bc-ae373c8057ff None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:39.036022 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51279518-a517-43d5-97bc-ae373c8057ff None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:39.036879 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51279518-a517-43d5-97bc-ae373c8057ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:39.037466 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51279518-a517-43d5-97bc-ae373c8057ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:39.039109 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51279518-a517-43d5-97bc-ae373c8057ff None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:39.057066 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 246/470] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:39.058483 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51279518-a517-43d5-97bc-ae373c8057ff None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:39.131431 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e842ff4-1256-497e-9b32-651d91488ca5 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:39.170979 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a94a17-992d-4649-8950-39263cea54cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:39.171612 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a94a17-992d-4649-8950-39263cea54cf None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:39.171853 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51279518-a517-43d5-97bc-ae373c8057ff None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:39.171958 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a94a17-992d-4649-8950-39263cea54cf None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:39.172146 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a94a17-992d-4649-8950-39263cea54cf None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:39.172805 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a94a17-992d-4649-8950-39263cea54cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:39.174393 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a94a17-992d-4649-8950-39263cea54cf None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:39.201650 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 225/471] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 15:05:39 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:05:39.202720 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a94a17-992d-4649-8950-39263cea54cf None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:39.214667 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:39.231523 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd6109-fc43-4627-b663-4ce2cc294f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:39.232177 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd6109-fc43-4627-b663-4ce2cc294f15 None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:39.232439 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd6109-fc43-4627-b663-4ce2cc294f15 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:39.232710 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd6109-fc43-4627-b663-4ce2cc294f15 None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:39.233367 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd6109-fc43-4627-b663-4ce2cc294f15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:39.234899 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd6109-fc43-4627-b663-4ce2cc294f15 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:39.265727 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 247/472] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 15:05:39 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:05:39.279943 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:39.346118 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a94a17-992d-4649-8950-39263cea54cf None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:39.388891 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cee270-e28c-447f-ba88-6bd0716db4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:39.389634 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cee270-e28c-447f-ba88-6bd0716db4a5 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:39.389950 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cee270-e28c-447f-ba88-6bd0716db4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:39.390223 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cee270-e28c-447f-ba88-6bd0716db4a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:39.403291 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cee270-e28c-447f-ba88-6bd0716db4a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:39.404787 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cee270-e28c-447f-ba88-6bd0716db4a5 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:39.422119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-c8cee270-e28c-447f-ba88-6bd0716db4a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:39.422119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:39.422119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:39.422119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:39.422119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:39.422119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:39.422119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:39.422119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:39.422119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:39.422119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:39.422119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:39.422119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:39.422119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:39.422119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:39.422119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:39.422119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:39.423098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:39.423098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:39.423098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:39.423098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:39.423098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:39.423098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:39.423098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:39.423098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:39.423098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:39.423098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:39.423098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:39.423098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:39.423098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:39.423098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:39.423098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:39.423098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:39.423098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:39.423955 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:39.423955 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:39.423955 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:39.423955 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 226/473] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:39.429681 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd6109-fc43-4627-b663-4ce2cc294f15 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:39.542607 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd6109-fc43-4627-b663-4ce2cc294f15 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:39.582869 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed214a-460b-464a-967a-e268cb0b7b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:39.583485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed214a-460b-464a-967a-e268cb0b7b20 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:39.583758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed214a-460b-464a-967a-e268cb0b7b20 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:39.584024 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed214a-460b-464a-967a-e268cb0b7b20 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:39.584658 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed214a-460b-464a-967a-e268cb0b7b20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:39.584953 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed214a-460b-464a-967a-e268cb0b7b20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:39.586475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed214a-460b-464a-967a-e268cb0b7b20 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:39.602891 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 248/474] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:39.609067 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cee270-e28c-447f-ba88-6bd0716db4a5 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:39.712225 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cee270-e28c-447f-ba88-6bd0716db4a5 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:39.714129 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:39.758076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57b070-e29b-45e6-8e5b-4b3088dc5049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:39.758783 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57b070-e29b-45e6-8e5b-4b3088dc5049 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:39.759058 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57b070-e29b-45e6-8e5b-4b3088dc5049 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:39.759325 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57b070-e29b-45e6-8e5b-4b3088dc5049 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:39.759969 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57b070-e29b-45e6-8e5b-4b3088dc5049 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:39.761431 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57b070-e29b-45e6-8e5b-4b3088dc5049 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:39.788308 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 227/475] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 15:05:39 2022] POST /identity/v3/users => generated 249 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:05:41.590193 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b2078-bb10-4a0c-b4ff-dd097f36e43c None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:41.590750 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b2078-bb10-4a0c-b4ff-dd097f36e43c None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:41.590750 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b2078-bb10-4a0c-b4ff-dd097f36e43c None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:41.592372 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 249/476] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:41.597924 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bbf08-64f1-446b-866a-3fd692b170ca None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:41.598339 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bbf08-64f1-446b-866a-3fd692b170ca None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:41.598504 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bbf08-64f1-446b-866a-3fd692b170ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:41.617342 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-a02bbf08-64f1-446b-866a-3fd692b170ca None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:41.618586 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-a02bbf08-64f1-446b-866a-3fd692b170ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:41.686307 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 228/477] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:41.735962 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9852a-5718-474a-ae75-12a9c070a41b None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:41.736524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9852a-5718-474a-ae75-12a9c070a41b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:41.736982 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9852a-5718-474a-ae75-12a9c070a41b None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:41.738781 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 250/478] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:41.744561 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84996eaa-3623-4b7d-9b57-81c1dcbe129d None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:41.745081 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84996eaa-3623-4b7d-9b57-81c1dcbe129d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:41.745548 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84996eaa-3623-4b7d-9b57-81c1dcbe129d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:41.764392 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-84996eaa-3623-4b7d-9b57-81c1dcbe129d None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:41.765570 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-84996eaa-3623-4b7d-9b57-81c1dcbe129d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:41.792814 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc4af9-44d0-4b5b-8d63-c066509a51f4 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:41.793460 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc4af9-44d0-4b5b-8d63-c066509a51f4 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:41.793950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc4af9-44d0-4b5b-8d63-c066509a51f4 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:41.795838 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 251/479] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:41.800628 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c3416-0d2e-4227-be19-5494243fcaa0 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:41.800908 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c3416-0d2e-4227-be19-5494243fcaa0 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:41.802097 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c3416-0d2e-4227-be19-5494243fcaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:41.820969 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-2d5c3416-0d2e-4227-be19-5494243fcaa0 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:41.822386 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-2d5c3416-0d2e-4227-be19-5494243fcaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:41.843800 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 229/480] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:41.869887 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:41.900434 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 252/481] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:42.038349 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84996eaa-3623-4b7d-9b57-81c1dcbe129d None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:42.057552 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:42.141994 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84996eaa-3623-4b7d-9b57-81c1dcbe129d None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:42.177503 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95aa12-4cb2-402e-abd0-37f4f0246940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:42.178186 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95aa12-4cb2-402e-abd0-37f4f0246940 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:42.178462 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95aa12-4cb2-402e-abd0-37f4f0246940 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:42.178732 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95aa12-4cb2-402e-abd0-37f4f0246940 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:42.189857 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95aa12-4cb2-402e-abd0-37f4f0246940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:42.195259 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-2f95aa12-4cb2-402e-abd0-37f4f0246940 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:42.195259 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:42.195259 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:42.195259 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:42.195259 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:42.195259 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:42.195259 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:42.195259 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:42.195259 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:42.195259 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:42.195259 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:42.195259 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:42.195259 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:42.195259 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:42.195259 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:42.195259 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:42.196276 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:42.196276 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:42.196276 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:42.196276 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:42.196276 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:42.196276 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:42.196276 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:42.196276 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:42.196276 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:42.196276 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:42.196276 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:42.196276 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:42.196276 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:42.196276 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:42.196276 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:42.196276 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:42.197087 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:42.197087 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:42.197087 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:42.197087 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:42.197087 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:42.197087 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:42.197087 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:42.197087 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:42.197087 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:42.197087 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:42.197087 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:42.197087 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:42.197087 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 230/482] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 15:05:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:42.202402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c3416-0d2e-4227-be19-5494243fcaa0 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:42.206641 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95aa12-4cb2-402e-abd0-37f4f0246940 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:42.288197 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:42.308170 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c3416-0d2e-4227-be19-5494243fcaa0 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:42.310712 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95aa12-4cb2-402e-abd0-37f4f0246940 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:42.342402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76d2a1-2975-407a-bdf2-61b6112b033b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:42.342995 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76d2a1-2975-407a-bdf2-61b6112b033b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:42.343267 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76d2a1-2975-407a-bdf2-61b6112b033b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:42.343531 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76d2a1-2975-407a-bdf2-61b6112b033b None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:42.343776 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5ebf0-cef5-40c0-9fb3-aed1c1b226f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:42.344177 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76d2a1-2975-407a-bdf2-61b6112b033b None admin] RBAC: Adding query filter params (name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:42.344400 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5ebf0-cef5-40c0-9fb3-aed1c1b226f5 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:42.344490 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76d2a1-2975-407a-bdf2-61b6112b033b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:42.344672 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5ebf0-cef5-40c0-9fb3-aed1c1b226f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:42.344938 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5ebf0-cef5-40c0-9fb3-aed1c1b226f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:42.345866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76d2a1-2975-407a-bdf2-61b6112b033b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:42.353774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 253/483] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 15:05:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:42.354554 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76d2a1-2975-407a-bdf2-61b6112b033b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:42.355210 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5ebf0-cef5-40c0-9fb3-aed1c1b226f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:42.361059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-98c5ebf0-cef5-40c0-9fb3-aed1c1b226f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:42.361059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:42.361059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:42.361059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:42.361059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:42.361059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:42.361059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:42.361059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:42.361059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:42.361059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:42.361059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:42.361059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:42.361059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:42.361059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:42.361059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:42.361059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:42.362072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:42.362072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:42.362072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:42.362072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:42.362072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:42.362072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:42.362072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:42.362072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:42.362072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:42.362072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:42.362072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:42.362072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:42.362072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:42.362072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:42.362072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:42.362072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:42.362907 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:42.362907 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:42.362907 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:42.362907 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:42.362907 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:42.362907 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:42.362907 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:42.362907 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:42.362907 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:42.362907 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:42.362907 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:42.362907 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:42.362907 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 231/484] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 15:05:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:42.363578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7df7bc-e4f7-4117-b17f-8d805fa93a3f None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:42.364130 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7df7bc-e4f7-4117-b17f-8d805fa93a3f None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:42.364130 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7df7bc-e4f7-4117-b17f-8d805fa93a3f None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:42.365475 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 232/485] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:42.368097 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7df7bc-e4f7-4117-b17f-8d805fa93a3f None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:42.395252 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:42.456818 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76d2a1-2975-407a-bdf2-61b6112b033b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:42.470346 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7df7bc-e4f7-4117-b17f-8d805fa93a3f None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:42.488942 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6dd75-dc34-499e-9de5-aef3c14d45f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:42.489558 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6dd75-dc34-499e-9de5-aef3c14d45f2 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:42.490183 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6dd75-dc34-499e-9de5-aef3c14d45f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:42.490183 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6dd75-dc34-499e-9de5-aef3c14d45f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:42.499697 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6dd75-dc34-499e-9de5-aef3c14d45f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:42.503009 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f698d2-ef81-4545-b749-20c0a893a0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:42.503633 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f698d2-ef81-4545-b749-20c0a893a0d4 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:42.503912 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f698d2-ef81-4545-b749-20c0a893a0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:42.504185 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f698d2-ef81-4545-b749-20c0a893a0d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:42.504800 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-1bb6dd75-dc34-499e-9de5-aef3c14d45f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:42.504800 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:42.504800 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:42.504800 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:42.504800 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:42.504800 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:42.504800 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:42.504800 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:42.504800 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:42.504800 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:42.504800 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:42.504800 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:42.504800 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:42.504800 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:42.504800 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:42.504800 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:42.505678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:42.505678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:42.505678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:42.505678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:42.505678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:42.505678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:42.505678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:42.505678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:42.505678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:42.505678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:42.505678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:42.505678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:42.505678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:42.505678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:42.505678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:42.505678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:42.506504 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:42.506504 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:42.506504 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:42.506504 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:42.506504 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:42.506504 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:42.506504 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:42.506504 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:42.506504 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:42.506504 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:42.506504 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:42.506504 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:42.506504 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 254/486] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 15:05:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:42.507178 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6dd75-dc34-499e-9de5-aef3c14d45f2 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:42.515396 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:42.521228 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f698d2-ef81-4545-b749-20c0a893a0d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:42.522769 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f698d2-ef81-4545-b749-20c0a893a0d4 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:42.537524 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-e3f698d2-ef81-4545-b749-20c0a893a0d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:42.537524 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:42.537524 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:42.537524 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:42.537524 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:42.537524 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:42.537524 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:42.537524 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:42.537524 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:42.537524 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:42.537524 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:42.537524 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:42.537524 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:42.537524 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:42.537524 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:42.537524 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:42.538539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:42.538539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:42.538539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:42.538539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:42.538539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:42.538539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:42.538539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:42.538539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:42.538539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:42.538539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:42.538539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:42.538539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:42.538539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:42.538539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:42.538539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:42.538539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:42.538539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:42.539430 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:42.539430 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:42.539430 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:42.539430 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 233/487] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:42.539799 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422f03a-313b-42f2-9e7d-b0042613c8e1 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:42.540075 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422f03a-313b-42f2-9e7d-b0042613c8e1 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:42.540345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422f03a-313b-42f2-9e7d-b0042613c8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:42.558406 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-8422f03a-313b-42f2-9e7d-b0042613c8e1 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:42.559632 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-8422f03a-313b-42f2-9e7d-b0042613c8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:42.605834 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:42.611832 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6dd75-dc34-499e-9de5-aef3c14d45f2 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:42.626811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 234/488] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:42.627636 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422f03a-313b-42f2-9e7d-b0042613c8e1 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:42.647364 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93882ce-4a81-4e4f-8300-b5982068d3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:42.647903 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93882ce-4a81-4e4f-8300-b5982068d3ed None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:42.648179 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93882ce-4a81-4e4f-8300-b5982068d3ed None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:42.648448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93882ce-4a81-4e4f-8300-b5982068d3ed None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:42.649191 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93882ce-4a81-4e4f-8300-b5982068d3ed None admin] RBAC: Adding query filter params (name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:42.649486 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93882ce-4a81-4e4f-8300-b5982068d3ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:42.651185 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93882ce-4a81-4e4f-8300-b5982068d3ed None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:42.659240 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 255/489] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 15:05:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:42.660334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93882ce-4a81-4e4f-8300-b5982068d3ed None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:42.753636 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422f03a-313b-42f2-9e7d-b0042613c8e1 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:42.763153 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93882ce-4a81-4e4f-8300-b5982068d3ed None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:42.775197 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:42.790917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5eaf6-8365-427d-8a33-9ae6ae13edcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:42.791541 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5eaf6-8365-427d-8a33-9ae6ae13edcb None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:42.791817 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5eaf6-8365-427d-8a33-9ae6ae13edcb None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:42.792091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5eaf6-8365-427d-8a33-9ae6ae13edcb None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:42.792752 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5eaf6-8365-427d-8a33-9ae6ae13edcb None admin] RBAC: Adding query filter params (name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:42.793057 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5eaf6-8365-427d-8a33-9ae6ae13edcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:42.794485 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5eaf6-8365-427d-8a33-9ae6ae13edcb None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:42.801078 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ed08a-1b06-4202-bc09-207f898a4d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:42.801963 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ed08a-1b06-4202-bc09-207f898a4d3b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:42.802426 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ed08a-1b06-4202-bc09-207f898a4d3b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:42.802528 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 235/490] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 15:05:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:42.802967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ed08a-1b06-4202-bc09-207f898a4d3b None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:42.803268 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5eaf6-8365-427d-8a33-9ae6ae13edcb None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:42.804175 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ed08a-1b06-4202-bc09-207f898a4d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:42.804657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ed08a-1b06-4202-bc09-207f898a4d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:42.807608 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ed08a-1b06-4202-bc09-207f898a4d3b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:42.819739 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 256/491] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:42.820567 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ed08a-1b06-4202-bc09-207f898a4d3b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:42.841116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:42.911128 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5eaf6-8365-427d-8a33-9ae6ae13edcb None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:42.922225 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ed08a-1b06-4202-bc09-207f898a4d3b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:42.946941 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cddc62-74d0-488b-a12b-ff4401a98fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:42.947619 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cddc62-74d0-488b-a12b-ff4401a98fac None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:42.947893 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cddc62-74d0-488b-a12b-ff4401a98fac None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:42.948180 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cddc62-74d0-488b-a12b-ff4401a98fac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:42.958329 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed42b8c-fdae-46f2-b3a8-cbc35bb8ff5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:42.958945 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed42b8c-fdae-46f2-b3a8-cbc35bb8ff5a None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:42.959068 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cddc62-74d0-488b-a12b-ff4401a98fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:42.959214 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed42b8c-fdae-46f2-b3a8-cbc35bb8ff5a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:42.959471 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed42b8c-fdae-46f2-b3a8-cbc35bb8ff5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:42.960522 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cddc62-74d0-488b-a12b-ff4401a98fac None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:42.969355 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed42b8c-fdae-46f2-b3a8-cbc35bb8ff5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:42.970806 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed42b8c-fdae-46f2-b3a8-cbc35bb8ff5a None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:42.975711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-02cddc62-74d0-488b-a12b-ff4401a98fac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:42.975711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:42.975711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:42.975711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:42.975711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:42.975711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:42.975711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:42.975711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:42.975711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:42.975711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:42.975711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:42.975711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:42.975711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:42.975711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:42.975711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:42.975711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:42.976788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:42.976788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:42.976788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:42.976788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:42.976788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:42.976788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:42.976788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:42.976788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:42.976788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:42.976788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:42.976788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:42.976788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:42.976788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:42.976788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:42.976788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:42.976788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:42.976788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:42.977644 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:42.977644 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:42.977644 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:42.977644 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 236/492] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:42.977644 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cddc62-74d0-488b-a12b-ff4401a98fac None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:42.987252 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-0ed42b8c-fdae-46f2-b3a8-cbc35bb8ff5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:42.987252 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:42.987252 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:42.987252 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:42.987252 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:42.987252 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:42.987252 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:42.987252 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:42.987252 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:42.987252 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:42.987252 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:42.987252 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:42.987252 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:42.987252 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:42.987252 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:42.987252 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:42.988209 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:42.988209 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:42.988209 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:42.988209 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:42.988209 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:42.988209 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:42.988209 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:42.988209 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:42.988209 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:42.988209 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:42.988209 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:42.988209 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:42.988209 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:42.988209 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:42.988209 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:42.988209 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:42.988209 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:42.989080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:42.989080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:42.989080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:42.989080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 257/493] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:42.989080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed42b8c-fdae-46f2-b3a8-cbc35bb8ff5a None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:43.010954 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:43.056443 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:43.075566 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cddc62-74d0-488b-a12b-ff4401a98fac None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:43.087485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed42b8c-fdae-46f2-b3a8-cbc35bb8ff5a None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:43.108627 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761a63b-7bf3-4707-8339-c32610f5bd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:43.109252 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761a63b-7bf3-4707-8339-c32610f5bd91 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:43.109525 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761a63b-7bf3-4707-8339-c32610f5bd91 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:43.109817 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761a63b-7bf3-4707-8339-c32610f5bd91 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:43.117168 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761a63b-7bf3-4707-8339-c32610f5bd91 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:43.118686 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761a63b-7bf3-4707-8339-c32610f5bd91 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:43.119944 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36556f-9737-4467-b08c-796095afd470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:43.120583 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36556f-9737-4467-b08c-796095afd470 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:43.120839 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36556f-9737-4467-b08c-796095afd470 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:43.121106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36556f-9737-4467-b08c-796095afd470 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:43.131065 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-b761a63b-7bf3-4707-8339-c32610f5bd91 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:05:43.131065 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:43.131065 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:43.131065 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:43.131065 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:43.131065 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:43.131065 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:43.131065 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:43.131065 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:43.131065 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:43.131065 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:43.131065 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:43.131065 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:05:43.131065 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:05:43.131065 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:05:43.131065 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:05:43.132006 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:43.132006 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:43.132006 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:05:43.132006 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:43.132006 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:05:43.132006 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:43.132006 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:43.132006 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:43.132006 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:43.132006 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:43.132006 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:43.132006 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:43.132006 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:43.132006 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:43.132006 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:43.132006 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:43.132006 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:43.132006 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:43.133003 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:43.133003 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:43.133003 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:05:43.133003 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:05:43.133003 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:05:43.133003 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:05:43.133003 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:05:43.133003 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:05:43.133003 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:05:43.133003 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:43.133527 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36556f-9737-4467-b08c-796095afd470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:43.133606 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 237/494] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Sep 23 15:05:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:43.133606 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761a63b-7bf3-4707-8339-c32610f5bd91 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:43.136446 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-cc36556f-9737-4467-b08c-796095afd470 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:43.136446 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:43.136446 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:43.136446 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:43.136446 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:43.136446 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:43.136446 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:43.136446 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:43.136446 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:43.136446 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:43.136446 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:43.136446 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:43.136446 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:43.136446 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:43.136446 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:43.136446 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:43.137402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:43.137402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:43.137402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:43.137402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:43.137402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:43.137402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:43.137402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:43.137402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:43.137402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:43.137402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:43.137402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:43.137402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:43.137402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:43.137402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:43.137402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:43.137402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:43.138235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:43.138235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:43.138235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:43.138235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:43.138235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:43.138235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:43.138235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:43.138235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:43.138235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:43.138235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:43.138235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:43.138235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:43.138235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 258/495] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 15:05:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:43.138893 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36556f-9737-4467-b08c-796095afd470 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:43.232923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:43.237722 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36556f-9737-4467-b08c-796095afd470 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:43.240122 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761a63b-7bf3-4707-8339-c32610f5bd91 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:43.264634 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:43.270643 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f273958-de11-44e6-b38f-cd9a34434c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:43.271246 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f273958-de11-44e6-b38f-cd9a34434c13 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:43.271521 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f273958-de11-44e6-b38f-cd9a34434c13 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:43.271793 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f273958-de11-44e6-b38f-cd9a34434c13 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:43.272424 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f273958-de11-44e6-b38f-cd9a34434c13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:43.272628 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcb1e5-add9-40fd-866f-3578573e1e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:43.272742 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f273958-de11-44e6-b38f-cd9a34434c13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:43.273234 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcb1e5-add9-40fd-866f-3578573e1e7e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:43.273568 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcb1e5-add9-40fd-866f-3578573e1e7e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:43.273869 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcb1e5-add9-40fd-866f-3578573e1e7e None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:43.274193 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f273958-de11-44e6-b38f-cd9a34434c13 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:43.274505 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcb1e5-add9-40fd-866f-3578573e1e7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:43.274804 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcb1e5-add9-40fd-866f-3578573e1e7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:43.276251 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcb1e5-add9-40fd-866f-3578573e1e7e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:43.285767 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 259/496] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:43.286541 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f273958-de11-44e6-b38f-cd9a34434c13 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:43.292614 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 238/497] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:43.292614 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcb1e5-add9-40fd-866f-3578573e1e7e None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:43.389273 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcb1e5-add9-40fd-866f-3578573e1e7e None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:43.392793 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f273958-de11-44e6-b38f-cd9a34434c13 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:43.425392 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b516133-707e-40c2-b243-69046aee1a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:43.426018 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b516133-707e-40c2-b243-69046aee1a5f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:43.426295 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b516133-707e-40c2-b243-69046aee1a5f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:43.426567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b516133-707e-40c2-b243-69046aee1a5f None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:43.427228 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b516133-707e-40c2-b243-69046aee1a5f None admin] RBAC: Adding query filter params (name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:43.427530 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b516133-707e-40c2-b243-69046aee1a5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:43.428907 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b516133-707e-40c2-b243-69046aee1a5f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:43.429622 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6aa51-edf0-4c4a-97bd-2fa4e89fbca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:43.430334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6aa51-edf0-4c4a-97bd-2fa4e89fbca7 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:43.430607 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6aa51-edf0-4c4a-97bd-2fa4e89fbca7 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:43.430873 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6aa51-edf0-4c4a-97bd-2fa4e89fbca7 None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:43.431582 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6aa51-edf0-4c4a-97bd-2fa4e89fbca7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:43.431877 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6aa51-edf0-4c4a-97bd-2fa4e89fbca7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:43.433324 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6aa51-edf0-4c4a-97bd-2fa4e89fbca7 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:43.436860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 239/498] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 15:05:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:43.437640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b516133-707e-40c2-b243-69046aee1a5f None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:43.455387 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:43.470861 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 260/499] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Sep 23 15:05:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:43.471672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6aa51-edf0-4c4a-97bd-2fa4e89fbca7 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:43.521953 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:43.537482 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b516133-707e-40c2-b243-69046aee1a5f None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:43.569780 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6aa51-edf0-4c4a-97bd-2fa4e89fbca7 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:43.572752 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350abf95-8967-4ccf-8f56-ae4bef127d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:43.573373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350abf95-8967-4ccf-8f56-ae4bef127d21 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:43.573645 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350abf95-8967-4ccf-8f56-ae4bef127d21 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:43.573947 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350abf95-8967-4ccf-8f56-ae4bef127d21 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:43.582643 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350abf95-8967-4ccf-8f56-ae4bef127d21 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:43.584100 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350abf95-8967-4ccf-8f56-ae4bef127d21 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:43.595635 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-350abf95-8967-4ccf-8f56-ae4bef127d21 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 15:05:43.595635 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:43.595635 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:43.595635 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:43.595635 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:43.595635 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:43.595635 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:43.595635 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:43.595635 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:43.595635 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:43.595635 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:43.595635 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:43.595635 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:05:43.595635 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:05:43.595635 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:05:43.595635 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:05:43.596713 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:43.596713 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:43.596713 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:05:43.596713 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:43.596713 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:05:43.596713 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:43.596713 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:43.596713 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:43.596713 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:43.596713 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:43.596713 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:43.596713 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:43.596713 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:43.596713 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:43.596713 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:43.596713 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:43.596713 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:43.596713 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:43.597617 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:43.597617 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:43.597617 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:05:43.597617 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:05:43.597617 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:05:43.597617 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:05:43.597617 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:05:43.597617 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:05:43.597617 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 15:05:43.597617 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:43.597617 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 240/500] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:43.597617 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350abf95-8967-4ccf-8f56-ae4bef127d21 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:43.610354 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0c722-2086-497b-b35e-ffea93b6f898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:43.611004 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0c722-2086-497b-b35e-ffea93b6f898 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:43.611272 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0c722-2086-497b-b35e-ffea93b6f898 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:43.611532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0c722-2086-497b-b35e-ffea93b6f898 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:43.618682 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0c722-2086-497b-b35e-ffea93b6f898 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:43.620128 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0c722-2086-497b-b35e-ffea93b6f898 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:43.632636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-1ed0c722-2086-497b-b35e-ffea93b6f898 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 23 15:05:43.632636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:43.632636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:43.632636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:43.632636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:43.632636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:43.632636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:43.632636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:43.632636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:43.632636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:43.632636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:43.632636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:43.632636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:05:43.632636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:05:43.632636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:05:43.632636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:05:43.633626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:43.633626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:43.633626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:05:43.633626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:43.633626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:05:43.633626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:43.633626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:43.633626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:43.633626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:43.633626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:43.633626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:43.633626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:43.633626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:43.633626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:43.633626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:43.633626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:43.633626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:43.633626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:43.634551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:43.634551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:43.634551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:05:43.634551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:05:43.634551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:05:43.634551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:05:43.634551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:05:43.634551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:05:43.634551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 23 15:05:43.634551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:43.634551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 261/501] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:43.634551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0c722-2086-497b-b35e-ffea93b6f898 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:43.679959 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:43.705575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350abf95-8967-4ccf-8f56-ae4bef127d21 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:43.738206 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0c722-2086-497b-b35e-ffea93b6f898 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:43.743671 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25427b8-8436-430f-8512-2e1dee4ea8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:43.744297 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25427b8-8436-430f-8512-2e1dee4ea8ac None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:43.744569 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25427b8-8436-430f-8512-2e1dee4ea8ac None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:43.744823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25427b8-8436-430f-8512-2e1dee4ea8ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:43.747234 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:43.755412 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25427b8-8436-430f-8512-2e1dee4ea8ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:43.756857 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25427b8-8436-430f-8512-2e1dee4ea8ac None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:43.770599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-a25427b8-8436-430f-8512-2e1dee4ea8ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:43.770599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:43.770599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:43.770599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:43.770599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:43.770599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:43.770599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:43.770599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:43.770599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:43.770599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:43.770599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:43.770599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:43.770599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:43.770599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:43.770599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:43.770599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:43.771675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:43.771675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:43.771675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:43.771675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:43.771675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:43.771675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:43.771675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:43.771675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:43.771675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:43.771675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:43.771675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:43.771675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:43.771675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:43.771675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:43.771675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:43.771675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:43.771675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:43.772780 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:43.772780 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:43.772780 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:43.772780 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 241/502] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:43.772780 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25427b8-8436-430f-8512-2e1dee4ea8ac None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:43.774455 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89072eec-b121-467f-b3cf-f5f6928ba179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:43.775236 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89072eec-b121-467f-b3cf-f5f6928ba179 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:43.775513 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89072eec-b121-467f-b3cf-f5f6928ba179 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:43.776586 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89072eec-b121-467f-b3cf-f5f6928ba179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:43.843564 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89072eec-b121-467f-b3cf-f5f6928ba179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:43.845052 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89072eec-b121-467f-b3cf-f5f6928ba179 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:43.869185 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25427b8-8436-430f-8512-2e1dee4ea8ac None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:43.894623 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:43.903372 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb92902-0245-40d2-b2c8-adfdeee1a4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:43.904000 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb92902-0245-40d2-b2c8-adfdeee1a4ac None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:43.904267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb92902-0245-40d2-b2c8-adfdeee1a4ac None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:43.904536 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb92902-0245-40d2-b2c8-adfdeee1a4ac None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:43.905262 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb92902-0245-40d2-b2c8-adfdeee1a4ac None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:43.905567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb92902-0245-40d2-b2c8-adfdeee1a4ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:43.907039 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb92902-0245-40d2-b2c8-adfdeee1a4ac None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:43.942466 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 242/503] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Sep 23 15:05:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:43.947282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 262/504] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:43.947419 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb92902-0245-40d2-b2c8-adfdeee1a4ac None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:43.947508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89072eec-b121-467f-b3cf-f5f6928ba179 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:43.958666 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:44.044026 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb92902-0245-40d2-b2c8-adfdeee1a4ac None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:44.044195 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89072eec-b121-467f-b3cf-f5f6928ba179 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:44.076078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e1ab5-371d-459b-b9f6-b29cf536de81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:44.076257 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb7d5d-8afa-4a6d-a7c6-f2647d923e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:44.076696 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e1ab5-371d-459b-b9f6-b29cf536de81 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:44.076793 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb7d5d-8afa-4a6d-a7c6-f2647d923e35 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:44.076968 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e1ab5-371d-459b-b9f6-b29cf536de81 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:44.077056 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb7d5d-8afa-4a6d-a7c6-f2647d923e35 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:44.077232 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e1ab5-371d-459b-b9f6-b29cf536de81 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:44.077328 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb7d5d-8afa-4a6d-a7c6-f2647d923e35 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:44.077931 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb7d5d-8afa-4a6d-a7c6-f2647d923e35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:44.078021 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e1ab5-371d-459b-b9f6-b29cf536de81 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:44.078232 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb7d5d-8afa-4a6d-a7c6-f2647d923e35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:44.078318 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e1ab5-371d-459b-b9f6-b29cf536de81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:44.079619 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb7d5d-8afa-4a6d-a7c6-f2647d923e35 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:44.079709 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e1ab5-371d-459b-b9f6-b29cf536de81 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:44.090651 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 263/505] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:44.091607 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb7d5d-8afa-4a6d-a7c6-f2647d923e35 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:44.099262 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 243/506] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Sep 23 15:05:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:44.100275 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e1ab5-371d-459b-b9f6-b29cf536de81 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:44.145139 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:44.156466 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:44.191734 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb7d5d-8afa-4a6d-a7c6-f2647d923e35 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:44.199597 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e1ab5-371d-459b-b9f6-b29cf536de81 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:44.224572 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8bc7b-a035-4352-919a-7ffa14376ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:44.225178 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8bc7b-a035-4352-919a-7ffa14376ef5 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:44.225442 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8bc7b-a035-4352-919a-7ffa14376ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:44.225734 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8bc7b-a035-4352-919a-7ffa14376ef5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:44.237893 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90960ed4-e623-4604-af84-63bca9da45bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:44.238529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90960ed4-e623-4604-af84-63bca9da45bf None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:44.238798 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90960ed4-e623-4604-af84-63bca9da45bf None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:44.239048 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90960ed4-e623-4604-af84-63bca9da45bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:44.249475 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90960ed4-e623-4604-af84-63bca9da45bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:44.250977 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90960ed4-e623-4604-af84-63bca9da45bf None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:44.265373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-90960ed4-e623-4604-af84-63bca9da45bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:44.265373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:44.265373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:44.265373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:44.265373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:44.265373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:44.265373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:44.265373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:44.265373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:44.265373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:44.265373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:44.265373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:44.265373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:44.265373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:44.265373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:44.265373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:44.266468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:44.266468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:44.266468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:44.266468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:44.266468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:44.266468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:44.266468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:44.266468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:44.266468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:44.266468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:44.266468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:44.266468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:44.266468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:44.266468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:44.266468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:44.266468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:44.266468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:44.267337 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:44.267337 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:44.267337 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:44.267337 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 244/507] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:44.267717 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90960ed4-e623-4604-af84-63bca9da45bf None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:44.296099 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8bc7b-a035-4352-919a-7ffa14376ef5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:44.297493 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8bc7b-a035-4352-919a-7ffa14376ef5 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:44.357606 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:44.360645 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:44.363734 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90960ed4-e623-4604-af84-63bca9da45bf None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:44.394737 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 264/508] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:44.395553 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8bc7b-a035-4352-919a-7ffa14376ef5 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:44.397004 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fb28b-ff5f-473d-af78-7b6519cf8dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:44.397640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fb28b-ff5f-473d-af78-7b6519cf8dac None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:44.397947 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fb28b-ff5f-473d-af78-7b6519cf8dac None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:44.398217 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fb28b-ff5f-473d-af78-7b6519cf8dac None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:44.405936 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760fb28b-ff5f-473d-af78-7b6519cf8dac None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:44.407408 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760fb28b-ff5f-473d-af78-7b6519cf8dac None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:44.418467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-760fb28b-ff5f-473d-af78-7b6519cf8dac None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 15:05:44.418467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:44.418467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:44.418467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:44.418467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:44.418467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:44.418467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:44.418467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:44.418467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:44.418467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:44.418467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:44.418467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:44.418467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:05:44.418467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:05:44.418467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:05:44.418467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:05:44.419322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:44.419322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:44.419322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:05:44.419322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:44.419322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:05:44.419322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:44.419322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:44.419322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:44.419322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:44.419322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:44.419322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:44.419322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:44.419322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:44.419322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:44.419322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:44.419322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:44.419322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:44.419322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:44.420328 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:44.420328 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:44.420328 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:05:44.420328 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:05:44.420328 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:05:44.420328 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:05:44.420328 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:05:44.420328 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:05:44.420328 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 15:05:44.420328 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:44.420328 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 245/509] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 15:05:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:44.421042 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fb28b-ff5f-473d-af78-7b6519cf8dac None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:44.495278 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8bc7b-a035-4352-919a-7ffa14376ef5 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:44.519215 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fb28b-ff5f-473d-af78-7b6519cf8dac None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:44.529439 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fa365-a1c9-4ce7-bafc-d7fc480996b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:44.530084 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fa365-a1c9-4ce7-bafc-d7fc480996b9 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:44.530361 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fa365-a1c9-4ce7-bafc-d7fc480996b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:44.530633 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fa365-a1c9-4ce7-bafc-d7fc480996b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:44.554139 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70f8c5-119c-4dfd-877d-b5e00818c815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:44.554678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70f8c5-119c-4dfd-877d-b5e00818c815 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:44.554953 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70f8c5-119c-4dfd-877d-b5e00818c815 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:44.555223 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70f8c5-119c-4dfd-877d-b5e00818c815 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:44.555854 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc70f8c5-119c-4dfd-877d-b5e00818c815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:44.556154 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc70f8c5-119c-4dfd-877d-b5e00818c815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:44.557533 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc70f8c5-119c-4dfd-877d-b5e00818c815 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:44.564132 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:44.570171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 246/510] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:44.571208 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70f8c5-119c-4dfd-877d-b5e00818c815 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:44.589621 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:44.598415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fa365-a1c9-4ce7-bafc-d7fc480996b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:44.599918 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fa365-a1c9-4ce7-bafc-d7fc480996b9 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:44.669123 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70f8c5-119c-4dfd-877d-b5e00818c815 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:44.697250 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 265/511] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:44.698124 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fa365-a1c9-4ce7-bafc-d7fc480996b9 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:44.702982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde643d-962e-405f-8468-8c207fc6ef0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:44.703620 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde643d-962e-405f-8468-8c207fc6ef0c None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:44.703887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde643d-962e-405f-8468-8c207fc6ef0c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:44.704166 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde643d-962e-405f-8468-8c207fc6ef0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:44.715156 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde643d-962e-405f-8468-8c207fc6ef0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:44.716851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde643d-962e-405f-8468-8c207fc6ef0c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:44.732917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-ccde643d-962e-405f-8468-8c207fc6ef0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:44.732917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:44.732917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:44.732917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:44.732917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:44.732917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:44.732917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:44.732917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:44.732917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:44.732917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:44.732917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:44.732917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:44.732917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:44.732917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:44.732917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:44.732917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:44.734049 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:44.734049 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:44.734049 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:44.734049 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:44.734049 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:44.734049 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:44.734049 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:44.734049 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:44.734049 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:44.734049 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:44.734049 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:44.734049 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:44.734049 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:44.734049 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:44.734049 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:44.734049 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:44.734049 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:44.735375 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:44.735375 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:44.735375 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:44.735375 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 247/512] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:44.735375 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde643d-962e-405f-8468-8c207fc6ef0c None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:44.767478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:44.800806 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:44.804813 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fa365-a1c9-4ce7-bafc-d7fc480996b9 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:44.834499 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde643d-962e-405f-8468-8c207fc6ef0c None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:44.836629 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66cfe4-16d8-45ab-b2f8-f8ef93ee5122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:44.837240 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66cfe4-16d8-45ab-b2f8-f8ef93ee5122 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:44.837518 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66cfe4-16d8-45ab-b2f8-f8ef93ee5122 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:44.837815 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66cfe4-16d8-45ab-b2f8-f8ef93ee5122 None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:44.838530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66cfe4-16d8-45ab-b2f8-f8ef93ee5122 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:44.838831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66cfe4-16d8-45ab-b2f8-f8ef93ee5122 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:44.840254 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66cfe4-16d8-45ab-b2f8-f8ef93ee5122 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:44.857488 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 266/513] 10.222.0.48 () {56 vars in 1139 bytes} [Fri Sep 23 15:05:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:44.858463 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66cfe4-16d8-45ab-b2f8-f8ef93ee5122 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:44.867903 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c6e5a-b080-4ae3-8955-adf9be9cfe3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:44.868537 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c6e5a-b080-4ae3-8955-adf9be9cfe3a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:44.868812 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c6e5a-b080-4ae3-8955-adf9be9cfe3a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:44.869082 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c6e5a-b080-4ae3-8955-adf9be9cfe3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:44.875619 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c6e5a-b080-4ae3-8955-adf9be9cfe3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:44.877075 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c6e5a-b080-4ae3-8955-adf9be9cfe3a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:44.889171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-861c6e5a-b080-4ae3-8955-adf9be9cfe3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:44.889171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:44.889171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:44.889171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:44.889171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:44.889171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:44.889171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:44.889171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:44.889171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:44.889171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:44.889171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:44.889171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:44.889171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:05:44.889171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:05:44.889171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:05:44.890244 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:05:44.890244 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:44.890244 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:44.890244 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:44.890244 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:44.890244 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:44.890244 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:44.890244 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:44.890244 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:44.890244 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:44.890244 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:44.890244 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:44.890244 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:44.890244 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:44.890244 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:44.890244 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:44.890244 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:44.891105 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:05:44.891105 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:05:44.891105 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:05:44.891105 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:05:44.891105 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:05:44.891105 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:05:44.891105 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:44.891105 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:44.891105 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 248/514] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:05:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:44.891105 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c6e5a-b080-4ae3-8955-adf9be9cfe3a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:44.962570 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66cfe4-16d8-45ab-b2f8-f8ef93ee5122 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:44.988948 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:44.993150 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c6e5a-b080-4ae3-8955-adf9be9cfe3a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:44.997538 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1668a-63a4-49bd-bc68-8857bd1b1714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:44.998195 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1668a-63a4-49bd-bc68-8857bd1b1714 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:44.998467 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1668a-63a4-49bd-bc68-8857bd1b1714 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:44.998727 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1668a-63a4-49bd-bc68-8857bd1b1714 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:45.008572 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1668a-63a4-49bd-bc68-8857bd1b1714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:45.010081 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1668a-63a4-49bd-bc68-8857bd1b1714 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:45.019241 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:45.025351 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-17b1668a-63a4-49bd-bc68-8857bd1b1714 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:45.025351 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:45.025351 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:45.025351 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:45.025351 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:45.025351 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:45.025351 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:45.025351 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:45.025351 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:45.025351 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:45.025351 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:45.025351 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:45.025351 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:45.025351 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:45.025351 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:45.025351 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:45.026326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:45.026326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:45.026326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:45.026326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:45.026326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:45.026326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:45.026326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:45.026326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:45.026326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:45.026326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:45.026326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:45.026326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:45.026326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:45.026326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:45.026326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:45.026326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:45.026326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:45.027183 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:45.027183 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:45.027183 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:45.027183 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 267/515] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:45.027395 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1668a-63a4-49bd-bc68-8857bd1b1714 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:45.032440 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a876d54-c00c-4996-ab1c-5f94bbb1ac5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:45.033053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a876d54-c00c-4996-ab1c-5f94bbb1ac5d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:45.033325 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a876d54-c00c-4996-ab1c-5f94bbb1ac5d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:45.033588 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a876d54-c00c-4996-ab1c-5f94bbb1ac5d None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:45.034263 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a876d54-c00c-4996-ab1c-5f94bbb1ac5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:45.034562 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a876d54-c00c-4996-ab1c-5f94bbb1ac5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:45.035926 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a876d54-c00c-4996-ab1c-5f94bbb1ac5d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:45.048319 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 249/516] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:45.049099 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a876d54-c00c-4996-ab1c-5f94bbb1ac5d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:45.129814 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1668a-63a4-49bd-bc68-8857bd1b1714 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:45.145315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a876d54-c00c-4996-ab1c-5f94bbb1ac5d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:45.162639 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939529a-9c11-472b-8f76-47b163976e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:45.163248 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939529a-9c11-472b-8f76-47b163976e0f None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:45.163534 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939529a-9c11-472b-8f76-47b163976e0f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:45.163829 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939529a-9c11-472b-8f76-47b163976e0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:45.177749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04500d7b-d994-477c-adea-d5c655d1787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:45.178354 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04500d7b-d994-477c-adea-d5c655d1787c None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:45.178626 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04500d7b-d994-477c-adea-d5c655d1787c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:45.178890 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04500d7b-d994-477c-adea-d5c655d1787c None admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:45.179572 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04500d7b-d994-477c-adea-d5c655d1787c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:45.179907 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04500d7b-d994-477c-adea-d5c655d1787c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:45.181335 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04500d7b-d994-477c-adea-d5c655d1787c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:45.198182 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 250/517] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 15:05:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:45.203348 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04500d7b-d994-477c-adea-d5c655d1787c None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:45.208077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:45.230266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939529a-9c11-472b-8f76-47b163976e0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:45.232070 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939529a-9c11-472b-8f76-47b163976e0f None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:45.251039 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:45.300928 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04500d7b-d994-477c-adea-d5c655d1787c None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:45.325223 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 268/518] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:45.326241 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939529a-9c11-472b-8f76-47b163976e0f None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:45.333770 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aef604-1112-4410-9353-1a21a8e2615e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:45.334380 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aef604-1112-4410-9353-1a21a8e2615e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:45.334658 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aef604-1112-4410-9353-1a21a8e2615e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:45.334930 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aef604-1112-4410-9353-1a21a8e2615e None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:45.335568 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aef604-1112-4410-9353-1a21a8e2615e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:45.335872 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aef604-1112-4410-9353-1a21a8e2615e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:45.337292 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aef604-1112-4410-9353-1a21a8e2615e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:45.348587 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 251/519] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:45.349419 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aef604-1112-4410-9353-1a21a8e2615e None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:45.406380 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:45.427242 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939529a-9c11-472b-8f76-47b163976e0f None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:45.449112 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aef604-1112-4410-9353-1a21a8e2615e None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:45.458309 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:45.459447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacf5ab-f72e-4851-a962-7e105efd59d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:45.460075 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacf5ab-f72e-4851-a962-7e105efd59d7 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:45.460346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacf5ab-f72e-4851-a962-7e105efd59d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:45.460919 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacf5ab-f72e-4851-a962-7e105efd59d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:45.467458 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacf5ab-f72e-4851-a962-7e105efd59d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:45.468895 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacf5ab-f72e-4851-a962-7e105efd59d7 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:45.480498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-3cacf5ab-f72e-4851-a962-7e105efd59d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:45.480498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:45.480498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:45.480498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:45.480498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:45.480498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:45.480498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:45.480498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:45.480498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:45.480498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:45.480498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:45.480498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:45.480498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:05:45.480498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:05:45.480498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:05:45.481758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:05:45.481758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:45.481758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:45.481758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:45.481758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:45.481758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:45.481758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:45.481758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:45.481758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:45.481758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:45.481758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:45.481758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:45.481758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:45.481758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:45.481758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:45.481758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:45.481758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:45.482653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:05:45.482653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:05:45.482653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:05:45.482653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:05:45.482653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:05:45.482653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:05:45.482653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:45.482653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:45.483313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 269/520] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:05:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:45.484238 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacf5ab-f72e-4851-a962-7e105efd59d7 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:45.490322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b63a75-323d-40c1-8f3a-c3e2b3d57a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:45.490969 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b63a75-323d-40c1-8f3a-c3e2b3d57a98 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:45.491244 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b63a75-323d-40c1-8f3a-c3e2b3d57a98 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:45.491512 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b63a75-323d-40c1-8f3a-c3e2b3d57a98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:45.492233 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b63a75-323d-40c1-8f3a-c3e2b3d57a98 None admin] RBAC: Adding query filter params (role.id=008dc5c4798945a8bc61788f87211b2a, scope.project.id=1fd85e9620ea42a69363d006d715ad04, user.id=542c7a84dd044588a42a9e3414cab516) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:45.492624 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b63a75-323d-40c1-8f3a-c3e2b3d57a98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:45.494088 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b63a75-323d-40c1-8f3a-c3e2b3d57a98 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:45.499702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 252/521] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:05:45 2022] GET /identity/v3/role_assignments?user.id=542c7a84dd044588a42a9e3414cab516&scope.project.id=1fd85e9620ea42a69363d006d715ad04&role.id=008dc5c4798945a8bc61788f87211b2a => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:45.500435 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b63a75-323d-40c1-8f3a-c3e2b3d57a98 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:45.588029 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacf5ab-f72e-4851-a962-7e105efd59d7 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:45.625336 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b63a75-323d-40c1-8f3a-c3e2b3d57a98 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:45.626017 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9fe65-6798-4251-8dff-a6dc693b5823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:45.626653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9fe65-6798-4251-8dff-a6dc693b5823 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:45.626935 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9fe65-6798-4251-8dff-a6dc693b5823 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:45.627191 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9fe65-6798-4251-8dff-a6dc693b5823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:45.635783 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:45.641069 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9fe65-6798-4251-8dff-a6dc693b5823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:45.642551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9fe65-6798-4251-8dff-a6dc693b5823 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:45.658251 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-4db9fe65-6798-4251-8dff-a6dc693b5823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:45.658251 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:45.658251 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:45.658251 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:45.658251 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:45.658251 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:45.658251 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:45.658251 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:45.658251 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:45.658251 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:45.658251 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:45.658251 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:45.658251 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:45.658251 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:45.658251 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:45.658251 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:45.659208 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:45.659208 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:45.659208 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:45.659208 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:45.659208 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:45.659208 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:45.659208 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:45.659208 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:45.659208 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:45.659208 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:45.659208 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:45.659208 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:45.659208 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:45.659208 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:45.659208 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:45.659208 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:45.659208 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:45.660067 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:45.660067 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:45.660067 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:45.660067 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 270/522] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:45.660067 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9fe65-6798-4251-8dff-a6dc693b5823 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:45.670306 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be66b0-d7cb-4703-a5b7-d51cdb3e3a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:45.670962 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be66b0-d7cb-4703-a5b7-d51cdb3e3a91 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:45.671235 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be66b0-d7cb-4703-a5b7-d51cdb3e3a91 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:45.671501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be66b0-d7cb-4703-a5b7-d51cdb3e3a91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:45.679229 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be66b0-d7cb-4703-a5b7-d51cdb3e3a91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:45.680800 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be66b0-d7cb-4703-a5b7-d51cdb3e3a91 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:45.692906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-46be66b0-d7cb-4703-a5b7-d51cdb3e3a91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:45.692906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:45.692906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:45.692906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:45.692906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:45.692906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:45.692906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:45.692906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:45.692906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:45.692906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:45.692906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:45.692906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:45.692906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:05:45.692906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:05:45.692906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:05:45.693882 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:05:45.693882 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:45.693882 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:45.693882 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:45.693882 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:45.693882 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:45.693882 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:45.693882 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:45.693882 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:45.693882 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:45.693882 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:45.693882 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:45.693882 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:45.693882 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:45.693882 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:45.693882 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:45.693882 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:45.695174 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:05:45.695174 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:05:45.695174 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:05:45.695174 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:05:45.695174 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:05:45.695174 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:05:45.695174 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:45.695174 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:45.695174 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 253/523] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:05:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:45.695174 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be66b0-d7cb-4703-a5b7-d51cdb3e3a91 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:45.733593 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:45.776282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9fe65-6798-4251-8dff-a6dc693b5823 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:45.808316 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be66b0-d7cb-4703-a5b7-d51cdb3e3a91 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:45.813066 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991adfd1-50cc-420c-a786-417e284336d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:45.813929 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991adfd1-50cc-420c-a786-417e284336d1 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:45.814420 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991adfd1-50cc-420c-a786-417e284336d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:45.814872 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991adfd1-50cc-420c-a786-417e284336d1 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:45.816106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991adfd1-50cc-420c-a786-417e284336d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:45.816595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991adfd1-50cc-420c-a786-417e284336d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:45.818931 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991adfd1-50cc-420c-a786-417e284336d1 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:45.843338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 271/524] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 15:05:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:45.843338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991adfd1-50cc-420c-a786-417e284336d1 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:45.846464 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df05bfe-ae9b-44aa-bd91-2ac0342f9d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:45.847951 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df05bfe-ae9b-44aa-bd91-2ac0342f9d1c None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:45.848226 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df05bfe-ae9b-44aa-bd91-2ac0342f9d1c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:45.848496 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df05bfe-ae9b-44aa-bd91-2ac0342f9d1c None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:45.849139 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df05bfe-ae9b-44aa-bd91-2ac0342f9d1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:45.849436 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df05bfe-ae9b-44aa-bd91-2ac0342f9d1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:45.850849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df05bfe-ae9b-44aa-bd91-2ac0342f9d1c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:45.869253 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 254/525] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:45.870137 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df05bfe-ae9b-44aa-bd91-2ac0342f9d1c None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:45.894672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:45.945592 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991adfd1-50cc-420c-a786-417e284336d1 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:45.967829 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:45.981965 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df05bfe-ae9b-44aa-bd91-2ac0342f9d1c None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:45.986336 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce969826-f421-4ac7-965c-def716488c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:45.987028 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce969826-f421-4ac7-965c-def716488c80 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:45.987306 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce969826-f421-4ac7-965c-def716488c80 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:45.987575 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce969826-f421-4ac7-965c-def716488c80 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:45.988260 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce969826-f421-4ac7-965c-def716488c80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:45.988559 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce969826-f421-4ac7-965c-def716488c80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:45.990037 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce969826-f421-4ac7-965c-def716488c80 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:46.002574 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 272/526] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 15:05:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:46.003377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce969826-f421-4ac7-965c-def716488c80 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:46.022813 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c078d2-f947-4a20-9ca9-0f357d8cd42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:46.023460 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c078d2-f947-4a20-9ca9-0f357d8cd42f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:46.023745 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c078d2-f947-4a20-9ca9-0f357d8cd42f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:46.024003 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c078d2-f947-4a20-9ca9-0f357d8cd42f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:46.024734 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c078d2-f947-4a20-9ca9-0f357d8cd42f None admin] RBAC: Adding query filter params (role.id=008dc5c4798945a8bc61788f87211b2a, scope.project.id=1fd85e9620ea42a69363d006d715ad04, user.id=0274d60e5bf14a4a9d3477e0efe31988) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:46.025050 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c078d2-f947-4a20-9ca9-0f357d8cd42f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:46.026511 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c078d2-f947-4a20-9ca9-0f357d8cd42f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:46.032062 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 255/527] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:05:45 2022] GET /identity/v3/role_assignments?user.id=0274d60e5bf14a4a9d3477e0efe31988&scope.project.id=1fd85e9620ea42a69363d006d715ad04&role.id=008dc5c4798945a8bc61788f87211b2a => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:46.032821 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c078d2-f947-4a20-9ca9-0f357d8cd42f None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:46.137236 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce969826-f421-4ac7-965c-def716488c80 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:46.149772 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:46.173817 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c078d2-f947-4a20-9ca9-0f357d8cd42f None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:46.179156 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59925e9d-3de3-4d0c-b752-e4af39b27d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:46.179927 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59925e9d-3de3-4d0c-b752-e4af39b27d42 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:46.180267 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59925e9d-3de3-4d0c-b752-e4af39b27d42 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:46.180599 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59925e9d-3de3-4d0c-b752-e4af39b27d42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:46.188636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59925e9d-3de3-4d0c-b752-e4af39b27d42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:46.190347 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59925e9d-3de3-4d0c-b752-e4af39b27d42 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:46.203368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-59925e9d-3de3-4d0c-b752-e4af39b27d42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:46.203368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:46.203368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:46.203368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:46.203368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:46.203368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:46.203368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:46.203368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:46.203368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:46.203368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:46.203368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:46.203368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:46.203368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:05:46.203368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:05:46.203368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:05:46.204266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:05:46.204266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:46.204266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:46.204266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:46.204266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:46.204266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:46.204266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:46.204266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:46.204266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:46.204266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:46.204266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:46.204266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:46.204266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:46.204266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:46.204266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:46.204266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:46.204266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:46.205120 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:05:46.205120 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:05:46.205120 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:05:46.205120 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:05:46.205120 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:05:46.205120 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:05:46.205120 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:46.205120 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:46.205120 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 273/528] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:05:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:46.210542 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59925e9d-3de3-4d0c-b752-e4af39b27d42 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:46.220282 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7498a-351e-4214-9d2e-660c9699b0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:46.222024 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7498a-351e-4214-9d2e-660c9699b0af None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:46.222628 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7498a-351e-4214-9d2e-660c9699b0af None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:46.223085 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7498a-351e-4214-9d2e-660c9699b0af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:46.224618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7498a-351e-4214-9d2e-660c9699b0af None admin] RBAC: Adding query filter params (role.id=008dc5c4798945a8bc61788f87211b2a, scope.project.id=1fd85e9620ea42a69363d006d715ad04, user.id=2f4a48b97bf9405eb44f593c41fe1e4d) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:46.225555 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7498a-351e-4214-9d2e-660c9699b0af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:46.227620 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7498a-351e-4214-9d2e-660c9699b0af None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:46.245739 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 256/529] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:05:46 2022] GET /identity/v3/role_assignments?user.id=2f4a48b97bf9405eb44f593c41fe1e4d&scope.project.id=1fd85e9620ea42a69363d006d715ad04&role.id=008dc5c4798945a8bc61788f87211b2a => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:46.341480 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59925e9d-3de3-4d0c-b752-e4af39b27d42 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:46.380115 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066adf4-b44d-46ad-a52b-2fc669398175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:46.380735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066adf4-b44d-46ad-a52b-2fc669398175 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:46.381011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066adf4-b44d-46ad-a52b-2fc669398175 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:46.381279 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066adf4-b44d-46ad-a52b-2fc669398175 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:46.382013 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066adf4-b44d-46ad-a52b-2fc669398175 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:46.382315 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066adf4-b44d-46ad-a52b-2fc669398175 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:46.383834 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066adf4-b44d-46ad-a52b-2fc669398175 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:46.397744 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 274/530] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 15:05:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:46.403433 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7498a-351e-4214-9d2e-660c9699b0af None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:46.427704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:46.520009 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7498a-351e-4214-9d2e-660c9699b0af None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:46.553508 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f2dc6-6aa8-465e-b5a7-c52d0ffc1cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:46.554152 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f2dc6-6aa8-465e-b5a7-c52d0ffc1cc1 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:46.554429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f2dc6-6aa8-465e-b5a7-c52d0ffc1cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:46.554744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f2dc6-6aa8-465e-b5a7-c52d0ffc1cc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:46.555471 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f2dc6-6aa8-465e-b5a7-c52d0ffc1cc1 None admin] RBAC: Adding query filter params (role.id=008dc5c4798945a8bc61788f87211b2a, scope.project.id=1fd85e9620ea42a69363d006d715ad04, user.id=8098c9c25a384b33885bbe6bcaaf01a8) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:46.555774 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f2dc6-6aa8-465e-b5a7-c52d0ffc1cc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:46.557224 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f2dc6-6aa8-465e-b5a7-c52d0ffc1cc1 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:46.563325 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 257/531] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:05:46 2022] GET /identity/v3/role_assignments?user.id=8098c9c25a384b33885bbe6bcaaf01a8&scope.project.id=1fd85e9620ea42a69363d006d715ad04&role.id=008dc5c4798945a8bc61788f87211b2a => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:47.917024 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded0ae7-b423-4e0a-a51f-6da6e6bd83fd None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:47.917617 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded0ae7-b423-4e0a-a51f-6da6e6bd83fd None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:47.917617 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded0ae7-b423-4e0a-a51f-6da6e6bd83fd None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:47.919276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 275/532] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:47.924792 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b4f21-9aef-4bae-a50c-3d36d0a0a82d None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:47.925236 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b4f21-9aef-4bae-a50c-3d36d0a0a82d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:47.925325 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b4f21-9aef-4bae-a50c-3d36d0a0a82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:47.945192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-3e3b4f21-9aef-4bae-a50c-3d36d0a0a82d None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:47.946834 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-3e3b4f21-9aef-4bae-a50c-3d36d0a0a82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:48.019135 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 258/533] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:48.342705 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded0ae7-b423-4e0a-a51f-6da6e6bd83fd None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:48.376190 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:48.455988 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded0ae7-b423-4e0a-a51f-6da6e6bd83fd None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:48.491640 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed766acc-966d-4045-9ce3-15f0c8213981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:48.492381 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed766acc-966d-4045-9ce3-15f0c8213981 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:48.492655 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed766acc-966d-4045-9ce3-15f0c8213981 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:48.492921 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed766acc-966d-4045-9ce3-15f0c8213981 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:48.503544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed766acc-966d-4045-9ce3-15f0c8213981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:48.507562 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c1e6b-2eef-4cd8-8393-0143f97857d3 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:48.507891 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c1e6b-2eef-4cd8-8393-0143f97857d3 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:48.508174 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c1e6b-2eef-4cd8-8393-0143f97857d3 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:48.508672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-ed766acc-966d-4045-9ce3-15f0c8213981 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:48.508672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:48.508672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:48.508672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:48.508672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:48.508672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:48.508672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:48.508672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:48.508672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:48.508672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:48.508672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:48.508672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:48.508672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:48.508672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:48.508672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:48.508672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:48.509616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:48.509616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:48.509616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:48.509616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:48.509616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:48.509616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:48.509616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:48.509616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:48.509616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:48.509616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:48.509616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:48.509616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:48.509616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:48.509616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:48.509616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:48.509616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:48.510517 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:48.510517 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:48.510517 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:48.510517 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:48.510517 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:48.510517 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:48.510517 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:48.510517 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:48.510517 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:48.510517 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:48.510517 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:48.510517 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:48.510517 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 276/535] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 15:05:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:48.514919 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 259/535] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:48.518657 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c1e6b-2eef-4cd8-8393-0143f97857d3 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:48.518892 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89b2ef-9948-4f47-a11a-5c52a0c77178 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:48.519267 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89b2ef-9948-4f47-a11a-5c52a0c77178 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:48.519449 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89b2ef-9948-4f47-a11a-5c52a0c77178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:48.535503 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:48.539852 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-db89b2ef-9948-4f47-a11a-5c52a0c77178 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:48.541066 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-db89b2ef-9948-4f47-a11a-5c52a0c77178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:48.618561 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 277/536] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:48.639738 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c1e6b-2eef-4cd8-8393-0143f97857d3 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:48.674096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c351bc-5fb5-4544-8a01-e9460391d7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:48.674724 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c351bc-5fb5-4544-8a01-e9460391d7c3 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:48.675000 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c351bc-5fb5-4544-8a01-e9460391d7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:48.675273 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c351bc-5fb5-4544-8a01-e9460391d7c3 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:48.675990 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c351bc-5fb5-4544-8a01-e9460391d7c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:48.676355 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c351bc-5fb5-4544-8a01-e9460391d7c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:48.677839 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c351bc-5fb5-4544-8a01-e9460391d7c3 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:48.689930 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 260/537] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 15:05:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:48.690102 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971056e5-1318-41dc-8ff1-f1843c2491c9 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:48.690315 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971056e5-1318-41dc-8ff1-f1843c2491c9 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:48.690588 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971056e5-1318-41dc-8ff1-f1843c2491c9 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:48.692129 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 278/538] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:05:48.692814 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c351bc-5fb5-4544-8a01-e9460391d7c3 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:48.696878 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b6abc-c0d7-4862-828f-687dd352b506 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:48.697158 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b6abc-c0d7-4862-828f-687dd352b506 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:48.697428 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b6abc-c0d7-4862-828f-687dd352b506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:48.718329 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-b02b6abc-c0d7-4862-828f-687dd352b506 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:48.719615 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-b02b6abc-c0d7-4862-828f-687dd352b506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:48.738927 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:48.778526 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:48.809388 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 279/539] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:05:48.810915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c351bc-5fb5-4544-8a01-e9460391d7c3 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:48.847571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155d1b9-e2dd-4709-9bf9-8d1e32fcd7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:48.848239 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155d1b9-e2dd-4709-9bf9-8d1e32fcd7de None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:48.848519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155d1b9-e2dd-4709-9bf9-8d1e32fcd7de None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:48.848786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155d1b9-e2dd-4709-9bf9-8d1e32fcd7de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:48.860297 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155d1b9-e2dd-4709-9bf9-8d1e32fcd7de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:48.861789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155d1b9-e2dd-4709-9bf9-8d1e32fcd7de None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:48.876852 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-b155d1b9-e2dd-4709-9bf9-8d1e32fcd7de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:48.876852 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:48.876852 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:48.876852 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:48.876852 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:48.876852 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:48.876852 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:48.876852 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:48.876852 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:48.876852 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:48.876852 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:48.876852 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:48.876852 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:48.876852 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:48.876852 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:48.876852 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:48.877788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:48.877788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:48.877788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:48.877788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:48.877788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:48.877788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:48.877788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:48.877788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:48.877788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:48.877788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:48.877788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:48.877788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:48.877788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:48.877788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:48.877788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:48.877788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:48.877788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:48.878645 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:48.878645 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:48.878645 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:48.882575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 261/540] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:48.884120 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b6abc-c0d7-4862-828f-687dd352b506 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:48.956144 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155d1b9-e2dd-4709-9bf9-8d1e32fcd7de None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:48.993805 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b6abc-c0d7-4862-828f-687dd352b506 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:49.034675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae1cc3-eb79-4160-8262-687d17b6ff14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:49.035294 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae1cc3-eb79-4160-8262-687d17b6ff14 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:49.035570 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae1cc3-eb79-4160-8262-687d17b6ff14 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:49.035835 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae1cc3-eb79-4160-8262-687d17b6ff14 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:49.036469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae1cc3-eb79-4160-8262-687d17b6ff14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:49.036767 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae1cc3-eb79-4160-8262-687d17b6ff14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:49.038176 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae1cc3-eb79-4160-8262-687d17b6ff14 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:49.053617 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 280/541] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:49.053617 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d9be5-82c5-4dab-9505-e93a142b2eb1 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:49.053617 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d9be5-82c5-4dab-9505-e93a142b2eb1 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:49.053617 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d9be5-82c5-4dab-9505-e93a142b2eb1 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:49.053617 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 281/542] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:49.056211 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d9be5-82c5-4dab-9505-e93a142b2eb1 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:49.069293 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:49.079215 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155d1b9-e2dd-4709-9bf9-8d1e32fcd7de None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:49.104801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:49.113567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f9f82-50f1-4264-861d-996ab0504b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:49.114235 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f9f82-50f1-4264-861d-996ab0504b76 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:49.114510 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f9f82-50f1-4264-861d-996ab0504b76 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:49.114791 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f9f82-50f1-4264-861d-996ab0504b76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:49.125070 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f9f82-50f1-4264-861d-996ab0504b76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:49.130513 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-540f9f82-50f1-4264-861d-996ab0504b76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:49.130513 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:49.130513 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:49.130513 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:49.130513 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:49.130513 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:49.130513 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:49.130513 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:49.130513 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:49.130513 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:49.130513 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:49.130513 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:49.130513 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:49.130513 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:49.130513 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:49.130513 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:49.131578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:49.131578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:49.131578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:49.131578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:49.131578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:49.131578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:49.131578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:49.131578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:49.131578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:49.131578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:49.131578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:49.131578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:49.131578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:49.131578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:49.131578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:49.131578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:49.132677 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:49.132677 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:49.132677 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:49.132677 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:49.132677 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:49.132677 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:49.132677 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:49.132677 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:49.132677 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:49.132677 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:49.132677 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:49.132677 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:49.138164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 262/543] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 15:05:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:05:49.139281 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e73680-cb29-4e53-8eba-eb9c111dc617 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:49.139565 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e73680-cb29-4e53-8eba-eb9c111dc617 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:49.139840 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e73680-cb29-4e53-8eba-eb9c111dc617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:49.157679 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-09e73680-cb29-4e53-8eba-eb9c111dc617 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:49.158889 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-09e73680-cb29-4e53-8eba-eb9c111dc617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:49.166803 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d9be5-82c5-4dab-9505-e93a142b2eb1 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:49.198668 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761a928-9bec-4ab8-a8cf-793960668a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:49.199279 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761a928-9bec-4ab8-a8cf-793960668a07 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:49.199554 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761a928-9bec-4ab8-a8cf-793960668a07 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:49.199824 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761a928-9bec-4ab8-a8cf-793960668a07 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:49.207311 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761a928-9bec-4ab8-a8cf-793960668a07 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:49.208762 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761a928-9bec-4ab8-a8cf-793960668a07 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:49.220085 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-8761a928-9bec-4ab8-a8cf-793960668a07 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:05:49.220085 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:49.220085 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:49.220085 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:49.220085 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:49.220085 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:49.220085 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:49.220085 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:49.220085 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:49.220085 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:49.220085 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:49.220085 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:49.220085 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:05:49.220085 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:05:49.220085 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:05:49.220085 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:05:49.220971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:49.220971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:49.220971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:05:49.220971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:49.220971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:05:49.220971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:49.220971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:49.220971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:49.220971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:49.220971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:49.220971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:49.220971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:49.220971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:49.220971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:49.220971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:49.220971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:49.220971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:49.220971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:49.221922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:49.221922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:49.221922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:05:49.221922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:05:49.221922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:05:49.221922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:05:49.221922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:05:49.221922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:05:49.221922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:05:49.221922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:49.221922 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 282/544] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Sep 23 15:05:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:49.222515 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761a928-9bec-4ab8-a8cf-793960668a07 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:49.222586 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 263/545] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:49.226715 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e73680-cb29-4e53-8eba-eb9c111dc617 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:49.298996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:49.330883 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761a928-9bec-4ab8-a8cf-793960668a07 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:49.334701 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e73680-cb29-4e53-8eba-eb9c111dc617 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:49.353865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:49.366082 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c17c4-88e9-48d2-8604-8bc4ba76adea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:49.366761 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c17c4-88e9-48d2-8604-8bc4ba76adea None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:49.367036 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c17c4-88e9-48d2-8604-8bc4ba76adea None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:49.367358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c17c4-88e9-48d2-8604-8bc4ba76adea None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:49.368009 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c17c4-88e9-48d2-8604-8bc4ba76adea None admin] RBAC: Adding query filter params (name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:49.368311 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c17c4-88e9-48d2-8604-8bc4ba76adea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:49.369712 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c17c4-88e9-48d2-8604-8bc4ba76adea None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:49.373203 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785117dd-3cc7-4325-a840-f0b30ba54ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:49.374099 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785117dd-3cc7-4325-a840-f0b30ba54ce0 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:49.374663 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785117dd-3cc7-4325-a840-f0b30ba54ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:49.375004 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785117dd-3cc7-4325-a840-f0b30ba54ce0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:49.381982 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 283/546] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 15:05:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:49.381982 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c17c4-88e9-48d2-8604-8bc4ba76adea None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:49.390802 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785117dd-3cc7-4325-a840-f0b30ba54ce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:49.396219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-785117dd-3cc7-4325-a840-f0b30ba54ce0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:49.396219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:49.396219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:49.396219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:49.396219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:49.396219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:49.396219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:49.396219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:49.396219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:49.396219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:49.396219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:49.396219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:49.396219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:49.396219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:49.396219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:49.396219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:49.397103 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:49.397103 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:49.397103 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:49.397103 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:49.397103 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:49.397103 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:49.397103 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:49.397103 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:49.397103 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:49.397103 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:49.397103 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:49.397103 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:49.397103 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:49.397103 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:49.397103 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:49.397103 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:49.398289 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:49.398289 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:49.398289 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:49.398289 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:49.398289 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:49.398289 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:49.398289 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:49.398289 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:49.398289 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:49.398289 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:49.398289 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:49.398289 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:49.398289 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 264/547] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 15:05:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:49.398289 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785117dd-3cc7-4325-a840-f0b30ba54ce0 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:49.491683 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c17c4-88e9-48d2-8604-8bc4ba76adea None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:49.498316 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785117dd-3cc7-4325-a840-f0b30ba54ce0 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:49.521731 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:49.527860 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380ca87-bc00-4a2e-8ad8-7296da4c89c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:49.528626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380ca87-bc00-4a2e-8ad8-7296da4c89c0 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:49.528732 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380ca87-bc00-4a2e-8ad8-7296da4c89c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:49.528985 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380ca87-bc00-4a2e-8ad8-7296da4c89c0 None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:49.529739 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380ca87-bc00-4a2e-8ad8-7296da4c89c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:49.530035 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380ca87-bc00-4a2e-8ad8-7296da4c89c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:49.531453 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380ca87-bc00-4a2e-8ad8-7296da4c89c0 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:49.533516 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac601a28-168c-49d1-b0aa-73ef1444f39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:49.534182 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac601a28-168c-49d1-b0aa-73ef1444f39a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:49.534457 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac601a28-168c-49d1-b0aa-73ef1444f39a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:49.534730 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac601a28-168c-49d1-b0aa-73ef1444f39a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:49.544911 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac601a28-168c-49d1-b0aa-73ef1444f39a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:49.546821 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac601a28-168c-49d1-b0aa-73ef1444f39a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:49.553249 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 284/548] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Sep 23 15:05:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:49.553249 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380ca87-bc00-4a2e-8ad8-7296da4c89c0 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:49.561678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-ac601a28-168c-49d1-b0aa-73ef1444f39a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:49.561678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:49.561678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:49.561678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:49.561678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:49.561678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:49.561678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:49.561678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:49.561678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:49.561678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:49.561678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:49.561678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:49.561678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:49.561678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:49.561678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:49.561678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:49.562704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:49.562704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:49.562704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:49.562704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:49.562704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:49.562704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:49.562704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:49.562704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:49.562704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:49.562704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:49.562704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:49.562704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:49.562704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:49.562704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:49.562704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:49.562704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:49.562704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:49.563560 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:49.563560 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:49.563560 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:49.563560 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 265/549] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:49.563560 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac601a28-168c-49d1-b0aa-73ef1444f39a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:49.593976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:49.649378 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380ca87-bc00-4a2e-8ad8-7296da4c89c0 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:49.661829 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac601a28-168c-49d1-b0aa-73ef1444f39a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:49.683012 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02563dda-ead2-494b-8643-d236d5a0ced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:49.683611 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02563dda-ead2-494b-8643-d236d5a0ced9 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:49.683879 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02563dda-ead2-494b-8643-d236d5a0ced9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:49.684179 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02563dda-ead2-494b-8643-d236d5a0ced9 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:49.685045 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02563dda-ead2-494b-8643-d236d5a0ced9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:49.685334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02563dda-ead2-494b-8643-d236d5a0ced9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:49.686760 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02563dda-ead2-494b-8643-d236d5a0ced9 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:49.694886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196c1d2-e1b0-4f1e-b052-705258bc6986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:49.695053 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 285/550] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 15:05:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:49.695638 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196c1d2-e1b0-4f1e-b052-705258bc6986 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:49.695806 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02563dda-ead2-494b-8643-d236d5a0ced9 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:49.695914 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196c1d2-e1b0-4f1e-b052-705258bc6986 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:49.696168 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196c1d2-e1b0-4f1e-b052-705258bc6986 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:49.709566 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196c1d2-e1b0-4f1e-b052-705258bc6986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:49.715024 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-9196c1d2-e1b0-4f1e-b052-705258bc6986 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:49.715024 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:49.715024 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:49.715024 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:49.715024 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:49.715024 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:49.715024 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:49.715024 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:49.715024 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:49.715024 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:49.715024 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:49.715024 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:49.715024 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:49.715024 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:49.715024 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:49.715024 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:49.715957 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:49.715957 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:49.715957 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:49.715957 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:49.715957 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:49.715957 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:49.715957 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:49.715957 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:49.715957 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:49.715957 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:49.715957 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:49.715957 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:49.715957 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:49.715957 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:49.715957 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:49.715957 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:49.716865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:49.716865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:49.716865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:49.716865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:49.716865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:49.716865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:49.716865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:49.716865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:49.716865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:49.716865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:49.716865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:49.716865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:49.716865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 266/551] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 15:05:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:49.718775 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196c1d2-e1b0-4f1e-b052-705258bc6986 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:49.763959 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:49.810758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02563dda-ead2-494b-8643-d236d5a0ced9 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:49.816544 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:49.826334 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196c1d2-e1b0-4f1e-b052-705258bc6986 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:49.844429 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b7f83-6939-4f13-953e-c9214296ca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:49.845061 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b7f83-6939-4f13-953e-c9214296ca02 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:49.845339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b7f83-6939-4f13-953e-c9214296ca02 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:49.845608 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b7f83-6939-4f13-953e-c9214296ca02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:49.856040 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b7f83-6939-4f13-953e-c9214296ca02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:49.857863 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b7f83-6939-4f13-953e-c9214296ca02 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:49.858887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9e7cc-9575-416c-8584-b13445d6ccef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:49.859495 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9e7cc-9575-416c-8584-b13445d6ccef None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:49.859769 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9e7cc-9575-416c-8584-b13445d6ccef None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:49.860043 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9e7cc-9575-416c-8584-b13445d6ccef None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:49.860680 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9e7cc-9575-416c-8584-b13445d6ccef None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:49.860997 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9e7cc-9575-416c-8584-b13445d6ccef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:49.862370 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9e7cc-9575-416c-8584-b13445d6ccef None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:49.871979 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-960b7f83-6939-4f13-953e-c9214296ca02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:49.871979 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:49.871979 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:49.871979 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:49.871979 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:49.871979 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:49.871979 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:49.871979 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:49.871979 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:49.871979 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:49.871979 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:49.871979 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:49.871979 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:49.871979 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:49.871979 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:49.871979 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:49.873088 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:49.873088 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:49.873088 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:49.873088 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:49.873088 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:49.873088 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:49.873088 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:49.873088 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:49.873088 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:49.873088 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:49.873088 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:49.873088 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:49.873088 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:49.873088 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:49.873088 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:49.873088 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:49.873088 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:49.874178 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:49.874178 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:49.874178 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:49.874178 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 286/552] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:49.874178 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b7f83-6939-4f13-953e-c9214296ca02 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:49.881249 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 267/553] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:49.881249 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9e7cc-9575-416c-8584-b13445d6ccef None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:49.975626 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9e7cc-9575-416c-8584-b13445d6ccef None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:49.977591 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b7f83-6939-4f13-953e-c9214296ca02 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:49.979943 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:50.009416 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae11f8-7760-4d96-80a8-5cc8c1580760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:50.010131 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae11f8-7760-4d96-80a8-5cc8c1580760 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:50.010410 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae11f8-7760-4d96-80a8-5cc8c1580760 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:50.010680 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae11f8-7760-4d96-80a8-5cc8c1580760 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:50.011332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae11f8-7760-4d96-80a8-5cc8c1580760 None admin] RBAC: Adding query filter params (name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:50.011632 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae11f8-7760-4d96-80a8-5cc8c1580760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:50.012013 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e882546-dcf5-4ba7-a13a-0a061dee0bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:50.012640 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e882546-dcf5-4ba7-a13a-0a061dee0bfd None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:50.012921 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e882546-dcf5-4ba7-a13a-0a061dee0bfd None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:50.013020 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae11f8-7760-4d96-80a8-5cc8c1580760 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:50.013194 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e882546-dcf5-4ba7-a13a-0a061dee0bfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:50.021247 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 268/554] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 15:05:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:50.022199 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae11f8-7760-4d96-80a8-5cc8c1580760 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:50.030900 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e882546-dcf5-4ba7-a13a-0a061dee0bfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:50.032402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e882546-dcf5-4ba7-a13a-0a061dee0bfd None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:50.038906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:50.048346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-3e882546-dcf5-4ba7-a13a-0a061dee0bfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:50.048346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:50.048346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:50.048346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:50.048346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:50.048346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:50.048346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:50.048346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:50.048346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:50.048346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:50.048346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:50.048346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:50.048346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:50.048346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:50.048346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:50.048346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:50.050179 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:50.050179 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:50.050179 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:50.050179 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:50.050179 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:50.050179 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:50.050179 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:50.050179 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:50.050179 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:50.050179 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:50.050179 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:50.050179 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:50.050179 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:50.050179 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:50.050179 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:50.050179 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:50.050179 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:50.051308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:50.051308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:50.051308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:50.051712 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 287/555] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:50.053032 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e882546-dcf5-4ba7-a13a-0a061dee0bfd None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:50.126697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae11f8-7760-4d96-80a8-5cc8c1580760 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:50.154899 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e882546-dcf5-4ba7-a13a-0a061dee0bfd None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:50.159335 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211b981-c91b-4aa4-a675-0f25643d1846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:50.159963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211b981-c91b-4aa4-a675-0f25643d1846 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:50.160234 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211b981-c91b-4aa4-a675-0f25643d1846 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:50.160500 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211b981-c91b-4aa4-a675-0f25643d1846 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:50.167982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211b981-c91b-4aa4-a675-0f25643d1846 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:50.169413 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211b981-c91b-4aa4-a675-0f25643d1846 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:50.182789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-7211b981-c91b-4aa4-a675-0f25643d1846 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 15:05:50.182789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:50.182789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:50.182789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:50.182789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:50.182789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:50.182789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:50.182789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:50.182789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:50.182789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:50.182789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:50.182789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:50.182789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:05:50.182789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:05:50.182789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:05:50.182789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:05:50.183946 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:50.183946 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:50.183946 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:05:50.183946 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:50.183946 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:05:50.183946 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:50.183946 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:50.183946 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:50.183946 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:50.183946 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:50.183946 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:50.183946 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:50.183946 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:50.183946 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:50.183946 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:50.183946 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:50.183946 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:50.183946 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:50.184919 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:50.184919 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:50.184919 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:05:50.184919 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:05:50.184919 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:05:50.184919 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:05:50.184919 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:05:50.184919 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:05:50.184919 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 15:05:50.184919 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:50.184919 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 269/556] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:50.184919 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211b981-c91b-4aa4-a675-0f25643d1846 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:50.191995 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d08122-e70f-4de6-8f18-60aaafe3dd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:50.192596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d08122-e70f-4de6-8f18-60aaafe3dd92 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:50.192872 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d08122-e70f-4de6-8f18-60aaafe3dd92 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:50.193145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d08122-e70f-4de6-8f18-60aaafe3dd92 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:50.193803 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d08122-e70f-4de6-8f18-60aaafe3dd92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:50.194100 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d08122-e70f-4de6-8f18-60aaafe3dd92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:50.195496 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d08122-e70f-4de6-8f18-60aaafe3dd92 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:50.207276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 288/557] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:50.208048 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d08122-e70f-4de6-8f18-60aaafe3dd92 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:50.226015 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:50.260341 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:50.290043 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211b981-c91b-4aa4-a675-0f25643d1846 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:50.305527 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d08122-e70f-4de6-8f18-60aaafe3dd92 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:50.322907 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7cab5-ef20-4b88-9132-2aa2a8bb5a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:50.323557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7cab5-ef20-4b88-9132-2aa2a8bb5a6e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:50.323827 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7cab5-ef20-4b88-9132-2aa2a8bb5a6e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:50.324090 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7cab5-ef20-4b88-9132-2aa2a8bb5a6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:50.334253 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7cab5-ef20-4b88-9132-2aa2a8bb5a6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:50.335686 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7cab5-ef20-4b88-9132-2aa2a8bb5a6e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:50.339608 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab8e68-de40-41bd-9994-49647fd334d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:50.340242 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab8e68-de40-41bd-9994-49647fd334d9 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:50.340521 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab8e68-de40-41bd-9994-49647fd334d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:50.340788 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab8e68-de40-41bd-9994-49647fd334d9 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:50.341413 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab8e68-de40-41bd-9994-49647fd334d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:50.341683 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab8e68-de40-41bd-9994-49647fd334d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:50.343100 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab8e68-de40-41bd-9994-49647fd334d9 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:50.352418 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-3fe7cab5-ef20-4b88-9132-2aa2a8bb5a6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:50.352418 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:50.352418 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:50.352418 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:50.352418 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:50.352418 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:50.352418 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:50.352418 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:50.352418 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:50.352418 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:50.352418 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:50.352418 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:50.352418 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:50.352418 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:50.352418 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:50.352418 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:50.353596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:50.353596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:50.353596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:50.353596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:50.353596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:50.353596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:50.353596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:50.353596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:50.353596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:50.353596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:50.353596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:50.353596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:50.353596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:50.353596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:50.353596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:50.353596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:50.353596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:50.354755 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:50.354755 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:50.354755 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:50.354755 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 270/558] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:50.354755 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7cab5-ef20-4b88-9132-2aa2a8bb5a6e None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:50.357978 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 289/559] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:50.359512 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab8e68-de40-41bd-9994-49647fd334d9 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:50.439252 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:50.459398 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7cab5-ef20-4b88-9132-2aa2a8bb5a6e None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:50.463314 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab8e68-de40-41bd-9994-49647fd334d9 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:50.482399 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:50.493606 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbc7e0-2ffd-45d1-82f5-7877e735a6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:50.494288 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbc7e0-2ffd-45d1-82f5-7877e735a6ef None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:50.494557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbc7e0-2ffd-45d1-82f5-7877e735a6ef None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:50.494817 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbc7e0-2ffd-45d1-82f5-7877e735a6ef None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:50.495535 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbc7e0-2ffd-45d1-82f5-7877e735a6ef None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:50.495840 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbc7e0-2ffd-45d1-82f5-7877e735a6ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:50.496316 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939d0a9-0846-4446-90d6-87f08c73ecc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:50.496944 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939d0a9-0846-4446-90d6-87f08c73ecc3 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:50.497215 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939d0a9-0846-4446-90d6-87f08c73ecc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:50.497313 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbc7e0-2ffd-45d1-82f5-7877e735a6ef None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:50.497483 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939d0a9-0846-4446-90d6-87f08c73ecc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:50.503966 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939d0a9-0846-4446-90d6-87f08c73ecc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:50.505425 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939d0a9-0846-4446-90d6-87f08c73ecc3 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:50.514039 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 271/560] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Sep 23 15:05:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:50.514827 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbc7e0-2ffd-45d1-82f5-7877e735a6ef None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:50.516352 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-d939d0a9-0846-4446-90d6-87f08c73ecc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:50.516352 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:50.516352 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:50.516352 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:50.516352 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:50.516352 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:50.516352 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:50.516352 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:50.516352 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:50.516352 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:50.516352 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:50.516352 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:50.516352 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:05:50.516352 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:05:50.516352 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:05:50.517227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:05:50.517227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:50.517227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:50.517227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:50.517227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:50.517227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:50.517227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:50.517227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:50.517227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:50.517227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:50.517227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:50.517227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:50.517227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:50.517227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:50.517227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:50.517227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:50.517227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:50.518150 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:05:50.518150 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:05:50.518150 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:05:50.518150 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:05:50.518150 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:05:50.518150 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:05:50.518150 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:50.518150 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:50.518150 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 290/561] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:05:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:50.518656 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939d0a9-0846-4446-90d6-87f08c73ecc3 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:50.614063 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939d0a9-0846-4446-90d6-87f08c73ecc3 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:50.614693 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbc7e0-2ffd-45d1-82f5-7877e735a6ef None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:50.648228 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540c94b-133b-4e78-af22-3b9727b61c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:50.648883 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540c94b-133b-4e78-af22-3b9727b61c8f None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:50.649158 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540c94b-133b-4e78-af22-3b9727b61c8f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:50.649424 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540c94b-133b-4e78-af22-3b9727b61c8f None admin] PATH_INFO: `/v3/users/glance` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:50.651178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e444dba-3ff4-47da-9ef8-b827077d7c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:50.651752 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e444dba-3ff4-47da-9ef8-b827077d7c32 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:50.652017 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e444dba-3ff4-47da-9ef8-b827077d7c32 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:50.652163 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:50.652301 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e444dba-3ff4-47da-9ef8-b827077d7c32 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:50.652968 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e444dba-3ff4-47da-9ef8-b827077d7c32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:50.653258 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e444dba-3ff4-47da-9ef8-b827077d7c32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:50.654736 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e444dba-3ff4-47da-9ef8-b827077d7c32 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:50.657718 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540c94b-133b-4e78-af22-3b9727b61c8f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:50.659271 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540c94b-133b-4e78-af22-3b9727b61c8f None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:50.666310 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 272/562] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:50.666933 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e444dba-3ff4-47da-9ef8-b827077d7c32 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:50.671046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-0540c94b-133b-4e78-af22-3b9727b61c8f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 23 15:05:50.671046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:50.671046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:50.671046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:50.671046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:50.671046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:50.671046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:50.671046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:50.671046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:50.671046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:50.671046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:50.671046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:50.671046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:05:50.671046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:05:50.671046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:05:50.671046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:05:50.672080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:50.672080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:50.672080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:05:50.672080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:50.672080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:05:50.672080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:50.672080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:50.672080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:50.672080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:50.672080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:50.672080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:50.672080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:50.672080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:50.672080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:50.672080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:50.672080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:50.672080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:50.672080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:50.673226 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:50.673226 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:50.673226 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:05:50.673226 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:05:50.673226 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:05:50.673226 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:05:50.673226 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:05:50.673226 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:05:50.673226 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 23 15:05:50.673226 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:50.673226 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 291/563] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:50.673226 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540c94b-133b-4e78-af22-3b9727b61c8f None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:50.713508 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:50.769237 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e444dba-3ff4-47da-9ef8-b827077d7c32 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:50.777774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540c94b-133b-4e78-af22-3b9727b61c8f None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:50.802446 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e053fc-1e7e-47a1-b25f-fa3ceba06ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:50.803080 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e053fc-1e7e-47a1-b25f-fa3ceba06ac3 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:50.803362 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e053fc-1e7e-47a1-b25f-fa3ceba06ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:50.803631 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e053fc-1e7e-47a1-b25f-fa3ceba06ac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:50.810009 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4c228-e971-40d6-a8c8-c2b6bd82518d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:50.810605 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4c228-e971-40d6-a8c8-c2b6bd82518d None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:50.810863 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4c228-e971-40d6-a8c8-c2b6bd82518d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:50.811130 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4c228-e971-40d6-a8c8-c2b6bd82518d None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:50.811807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4c228-e971-40d6-a8c8-c2b6bd82518d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:50.812102 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4c228-e971-40d6-a8c8-c2b6bd82518d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:50.813576 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4c228-e971-40d6-a8c8-c2b6bd82518d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:50.814422 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e053fc-1e7e-47a1-b25f-fa3ceba06ac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:50.815850 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e053fc-1e7e-47a1-b25f-fa3ceba06ac3 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:50.825202 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 292/564] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 15:05:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:50.825999 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4c228-e971-40d6-a8c8-c2b6bd82518d None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:50.830754 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-75e053fc-1e7e-47a1-b25f-fa3ceba06ac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:50.830754 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:50.830754 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:50.830754 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:50.830754 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:50.830754 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:50.830754 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:50.830754 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:50.830754 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:50.830754 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:50.830754 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:50.830754 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:50.830754 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:50.830754 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:50.830754 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:50.830754 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:50.831856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:50.831856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:50.831856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:50.831856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:50.831856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:50.831856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:50.831856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:50.831856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:50.831856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:50.831856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:50.831856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:50.831856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:50.831856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:50.831856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:50.831856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:50.831856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:50.831856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:50.832941 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:50.832941 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:50.832941 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:50.832941 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 273/565] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:50.832941 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e053fc-1e7e-47a1-b25f-fa3ceba06ac3 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:50.881549 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:50.924234 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:50.925247 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4c228-e971-40d6-a8c8-c2b6bd82518d None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:50.931682 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e053fc-1e7e-47a1-b25f-fa3ceba06ac3 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:50.958822 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de263f7-4773-4cbf-a057-50fe3192e493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:50.959445 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de263f7-4773-4cbf-a057-50fe3192e493 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:50.959743 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de263f7-4773-4cbf-a057-50fe3192e493 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:50.959995 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de263f7-4773-4cbf-a057-50fe3192e493 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:50.965352 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e47133-bafd-4579-b3a0-a1ee46702e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:50.965989 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e47133-bafd-4579-b3a0-a1ee46702e09 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:50.966263 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e47133-bafd-4579-b3a0-a1ee46702e09 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:50.966527 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e47133-bafd-4579-b3a0-a1ee46702e09 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:50.967264 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e47133-bafd-4579-b3a0-a1ee46702e09 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:50.967381 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de263f7-4773-4cbf-a057-50fe3192e493 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:50.967562 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e47133-bafd-4579-b3a0-a1ee46702e09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:50.968766 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de263f7-4773-4cbf-a057-50fe3192e493 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:50.968999 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e47133-bafd-4579-b3a0-a1ee46702e09 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:50.980509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-0de263f7-4773-4cbf-a057-50fe3192e493 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 15:05:50.980509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:50.980509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:50.980509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:50.980509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:50.980509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:50.980509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:50.980509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:50.980509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:50.980509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:50.980509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:50.980509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:50.980509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:05:50.980509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:05:50.980509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:05:50.980509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:05:50.981831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:50.981831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:50.981831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:05:50.981831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:50.981831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:05:50.981831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:50.981831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:50.981831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:50.981831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:50.981831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:50.981831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:50.981831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:50.981831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:50.981831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:50.981831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:50.981831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:50.981831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:50.981831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:50.982758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:50.982758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:50.982758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:05:50.982758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:05:50.982758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:05:50.982758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:05:50.982758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:05:50.982758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:05:50.982758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 15:05:50.982758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:50.982758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 293/566] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 15:05:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:50.982758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de263f7-4773-4cbf-a057-50fe3192e493 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:50.990732 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 274/567] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Sep 23 15:05:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:50.991519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e47133-bafd-4579-b3a0-a1ee46702e09 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:51.082110 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de263f7-4773-4cbf-a057-50fe3192e493 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:51.090263 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e47133-bafd-4579-b3a0-a1ee46702e09 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:51.099024 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:51.116643 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7879d9-6c08-4cf6-af88-2ae9ca804f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:51.117319 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7879d9-6c08-4cf6-af88-2ae9ca804f09 None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:51.117592 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7879d9-6c08-4cf6-af88-2ae9ca804f09 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:51.117887 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7879d9-6c08-4cf6-af88-2ae9ca804f09 None admin] PATH_INFO: `/v3/projects/1fd85e9620ea42a69363d006d715ad04/users/542c7a84dd044588a42a9e3414cab516/roles/008dc5c4798945a8bc61788f87211b2a` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:51.124147 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719ed96-01f5-4f76-9e88-8dc8a0d12815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:51.124748 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719ed96-01f5-4f76-9e88-8dc8a0d12815 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:51.125027 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719ed96-01f5-4f76-9e88-8dc8a0d12815 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:51.125299 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719ed96-01f5-4f76-9e88-8dc8a0d12815 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:51.126007 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719ed96-01f5-4f76-9e88-8dc8a0d12815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:51.126305 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719ed96-01f5-4f76-9e88-8dc8a0d12815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:51.127670 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719ed96-01f5-4f76-9e88-8dc8a0d12815 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:51.131552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7879d9-6c08-4cf6-af88-2ae9ca804f09 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fd85e9620ea42a69363d006d715ad04, user_id=542c7a84dd044588a42a9e3414cab516, role_id=008dc5c4798945a8bc61788f87211b2a)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:51.133036 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7879d9-6c08-4cf6-af88-2ae9ca804f09 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:51.139390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 275/568] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:51.140356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719ed96-01f5-4f76-9e88-8dc8a0d12815 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:51.147785 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 294/569] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 15:05:50 2022] PUT /identity/v3/projects/1fd85e9620ea42a69363d006d715ad04/users/542c7a84dd044588a42a9e3414cab516/roles/008dc5c4798945a8bc61788f87211b2a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:05:51.148571 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7879d9-6c08-4cf6-af88-2ae9ca804f09 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:51.164308 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:51.264697 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7879d9-6c08-4cf6-af88-2ae9ca804f09 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:51.266495 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719ed96-01f5-4f76-9e88-8dc8a0d12815 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:51.301423 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c59a24-f90b-4b33-bf48-fd36295da34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:51.302074 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828acaa7-6d9b-4937-b34a-5158971bb808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:51.302221 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c59a24-f90b-4b33-bf48-fd36295da34a None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:51.302410 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c59a24-f90b-4b33-bf48-fd36295da34a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:51.302636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c59a24-f90b-4b33-bf48-fd36295da34a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:51.302745 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828acaa7-6d9b-4937-b34a-5158971bb808 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:51.302961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828acaa7-6d9b-4937-b34a-5158971bb808 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:51.303232 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828acaa7-6d9b-4937-b34a-5158971bb808 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:51.303970 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828acaa7-6d9b-4937-b34a-5158971bb808 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:51.304273 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828acaa7-6d9b-4937-b34a-5158971bb808 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:51.305842 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828acaa7-6d9b-4937-b34a-5158971bb808 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:51.313863 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c59a24-f90b-4b33-bf48-fd36295da34a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:51.315350 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c59a24-f90b-4b33-bf48-fd36295da34a None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:51.329493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 276/570] 10.222.0.48 () {56 vars in 1139 bytes} [Fri Sep 23 15:05:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:51.329493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828acaa7-6d9b-4937-b34a-5158971bb808 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:51.337406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-d8c59a24-f90b-4b33-bf48-fd36295da34a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:51.337406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:51.337406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:51.337406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:51.337406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:51.337406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:51.337406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:51.337406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:51.337406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:51.337406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:51.337406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:51.337406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:51.337406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:51.337406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:51.337406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:51.337406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:51.338448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:51.338448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:51.338448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:51.338448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:51.338448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:51.338448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:51.338448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:51.338448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:51.338448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:51.338448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:51.338448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:51.338448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:51.338448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:51.338448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:51.338448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:51.338448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:51.338448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:51.344266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:51.344266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:51.344266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:51.344266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 295/571] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:51.344266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c59a24-f90b-4b33-bf48-fd36295da34a None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:51.367134 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:51.419123 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:51.453417 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c59a24-f90b-4b33-bf48-fd36295da34a None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:51.454448 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828acaa7-6d9b-4937-b34a-5158971bb808 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:51.488129 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3803ba-d51a-450e-bd78-629494f3275d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:51.488761 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3803ba-d51a-450e-bd78-629494f3275d None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:51.489041 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3803ba-d51a-450e-bd78-629494f3275d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:51.489313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3803ba-d51a-450e-bd78-629494f3275d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:51.491778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1799334-13fe-41ac-b11c-8c21e897689d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:51.493016 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1799334-13fe-41ac-b11c-8c21e897689d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:51.493504 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1799334-13fe-41ac-b11c-8c21e897689d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:51.493992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1799334-13fe-41ac-b11c-8c21e897689d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:51.499957 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3803ba-d51a-450e-bd78-629494f3275d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:51.501422 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3803ba-d51a-450e-bd78-629494f3275d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:51.502483 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1799334-13fe-41ac-b11c-8c21e897689d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:51.504492 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1799334-13fe-41ac-b11c-8c21e897689d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:51.516057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-bf3803ba-d51a-450e-bd78-629494f3275d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:51.516057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:51.516057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:51.516057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:51.516057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:51.516057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:51.516057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:51.516057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:51.516057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:51.516057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:51.516057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:51.516057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:51.516057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:51.516057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:51.516057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:51.516057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:51.517046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:51.517046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:51.517046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:51.517046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:51.517046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:51.517046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:51.517046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:51.517046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:51.517046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:51.517046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:51.517046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:51.517046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:51.517046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:51.517046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:51.517046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:51.517046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:51.517046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:51.522666 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:51.522666 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:51.522666 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:51.522839 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-d1799334-13fe-41ac-b11c-8c21e897689d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:51.522839 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:51.522839 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:51.522839 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:51.522839 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:51.522839 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:51.522839 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:51.522839 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:51.522839 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:51.522839 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:51.522839 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:51.522839 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:51.522839 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:05:51.522839 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:05:51.522839 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:05:51.523744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:05:51.523744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:51.523744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:51.523744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:51.523744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:51.523744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:51.523744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:51.523744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:51.523744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:51.523744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:51.523744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:51.523744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:51.523744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:51.523744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:51.523744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:51.523744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:51.523744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:51.524678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:05:51.524678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:05:51.524678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:05:51.524678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:05:51.524678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:05:51.524678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:05:51.524678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:51.524678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:51.525111 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 296/572] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:51.525189 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 277/573] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:05:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:51.525266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3803ba-d51a-450e-bd78-629494f3275d None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:51.525336 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1799334-13fe-41ac-b11c-8c21e897689d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:51.591115 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:51.623432 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3803ba-d51a-450e-bd78-629494f3275d None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:51.623676 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1799334-13fe-41ac-b11c-8c21e897689d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:51.653033 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:51.657365 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b421c1c-893a-4247-abac-04013f3e052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:51.658113 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b421c1c-893a-4247-abac-04013f3e052f None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:51.658428 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b421c1c-893a-4247-abac-04013f3e052f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:51.658684 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b421c1c-893a-4247-abac-04013f3e052f None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:51.659368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b421c1c-893a-4247-abac-04013f3e052f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:51.659671 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b421c1c-893a-4247-abac-04013f3e052f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:51.659868 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfc442-0c14-447b-8acb-870b304b1ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:51.660689 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfc442-0c14-447b-8acb-870b304b1ad3 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:51.660961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfc442-0c14-447b-8acb-870b304b1ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:51.661055 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b421c1c-893a-4247-abac-04013f3e052f None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:51.661224 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfc442-0c14-447b-8acb-870b304b1ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:51.661892 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfc442-0c14-447b-8acb-870b304b1ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:51.662190 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfc442-0c14-447b-8acb-870b304b1ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:51.663724 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfc442-0c14-447b-8acb-870b304b1ad3 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:51.675917 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 297/574] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:51.676207 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b421c1c-893a-4247-abac-04013f3e052f None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:51.681462 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 278/575] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:51.682783 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfc442-0c14-447b-8acb-870b304b1ad3 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:51.789473 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b421c1c-893a-4247-abac-04013f3e052f None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:51.803362 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfc442-0c14-447b-8acb-870b304b1ad3 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:51.820463 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:51.827482 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724c644-5849-4231-8a49-ff32bc4d8f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:51.828091 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724c644-5849-4231-8a49-ff32bc4d8f36 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:51.828376 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724c644-5849-4231-8a49-ff32bc4d8f36 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:51.828648 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724c644-5849-4231-8a49-ff32bc4d8f36 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:51.829331 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724c644-5849-4231-8a49-ff32bc4d8f36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:51.829639 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724c644-5849-4231-8a49-ff32bc4d8f36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:51.831154 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724c644-5849-4231-8a49-ff32bc4d8f36 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:51.837299 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c33e2-9986-4ebf-92c9-ee0b6993b0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:51.838365 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c33e2-9986-4ebf-92c9-ee0b6993b0ef None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:51.838365 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c33e2-9986-4ebf-92c9-ee0b6993b0ef None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:51.838580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c33e2-9986-4ebf-92c9-ee0b6993b0ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:51.848920 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 298/576] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 15:05:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:51.849088 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c33e2-9986-4ebf-92c9-ee0b6993b0ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:51.849190 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724c644-5849-4231-8a49-ff32bc4d8f36 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:51.849276 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c33e2-9986-4ebf-92c9-ee0b6993b0ef None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:51.861571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-1a4c33e2-9986-4ebf-92c9-ee0b6993b0ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:51.861571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:51.861571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:51.861571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:51.861571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:51.861571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:51.861571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:51.861571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:51.861571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:51.861571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:51.861571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:51.861571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:51.861571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:05:51.861571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:05:51.861571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:05:51.862750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:05:51.862750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:51.862750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:51.862750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:51.862750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:51.862750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:51.862750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:51.862750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:51.862750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:51.862750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:51.862750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:51.862750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:51.862750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:51.862750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:51.862750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:51.862750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:51.862750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:51.863668 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:05:51.863668 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:05:51.863668 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:05:51.863668 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:05:51.863668 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:05:51.863668 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:05:51.863668 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:51.863668 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:51.863668 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 279/577] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:05:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:51.863668 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c33e2-9986-4ebf-92c9-ee0b6993b0ef None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:51.921356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:51.963667 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724c644-5849-4231-8a49-ff32bc4d8f36 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:51.978778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c33e2-9986-4ebf-92c9-ee0b6993b0ef None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:51.997861 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324e2c7-85aa-4c51-894d-eeb840067861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:51.998489 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324e2c7-85aa-4c51-894d-eeb840067861 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:51.998766 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324e2c7-85aa-4c51-894d-eeb840067861 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:51.999030 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324e2c7-85aa-4c51-894d-eeb840067861 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:52.005665 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324e2c7-85aa-4c51-894d-eeb840067861 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:52.007163 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324e2c7-85aa-4c51-894d-eeb840067861 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:52.016756 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56436a9-d7f2-42af-80ee-973117a720a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:52.017429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56436a9-d7f2-42af-80ee-973117a720a6 None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:52.017714 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56436a9-d7f2-42af-80ee-973117a720a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:52.018005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56436a9-d7f2-42af-80ee-973117a720a6 None admin] PATH_INFO: `/v3/projects/1fd85e9620ea42a69363d006d715ad04/users/0274d60e5bf14a4a9d3477e0efe31988/roles/008dc5c4798945a8bc61788f87211b2a` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:52.018468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-0324e2c7-85aa-4c51-894d-eeb840067861 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:52.018468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:52.018468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:52.018468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:52.018468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:52.018468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:52.018468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:52.018468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:52.018468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:52.018468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:52.018468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:52.018468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:52.018468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:05:52.018468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:05:52.018468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:05:52.019523 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:05:52.019523 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:52.019523 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:52.019523 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:52.019523 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:52.019523 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:52.019523 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:52.019523 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:52.019523 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:52.019523 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:52.019523 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:52.019523 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:52.019523 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:52.019523 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:52.019523 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:52.019523 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:52.019523 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:52.020447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:05:52.020447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:05:52.020447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:05:52.020447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:05:52.020447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:05:52.020447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:05:52.020447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:52.020447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:52.020447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 299/578] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:05:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:52.020447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324e2c7-85aa-4c51-894d-eeb840067861 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:52.037775 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56436a9-d7f2-42af-80ee-973117a720a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fd85e9620ea42a69363d006d715ad04, user_id=0274d60e5bf14a4a9d3477e0efe31988, role_id=008dc5c4798945a8bc61788f87211b2a)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:52.039405 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56436a9-d7f2-42af-80ee-973117a720a6 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:52.054128 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 280/579] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 15:05:51 2022] PUT /identity/v3/projects/1fd85e9620ea42a69363d006d715ad04/users/0274d60e5bf14a4a9d3477e0efe31988/roles/008dc5c4798945a8bc61788f87211b2a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:05:52.054871 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56436a9-d7f2-42af-80ee-973117a720a6 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:52.101060 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:52.161067 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324e2c7-85aa-4c51-894d-eeb840067861 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:52.178922 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:52.182362 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56436a9-d7f2-42af-80ee-973117a720a6 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:52.207958 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03249759-f246-46c8-815b-345069a0f295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:52.208693 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03249759-f246-46c8-815b-345069a0f295 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:52.208975 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03249759-f246-46c8-815b-345069a0f295 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:52.209247 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03249759-f246-46c8-815b-345069a0f295 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:52.210014 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03249759-f246-46c8-815b-345069a0f295 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:52.210322 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03249759-f246-46c8-815b-345069a0f295 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:52.212158 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03249759-f246-46c8-815b-345069a0f295 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:52.228045 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 300/580] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 15:05:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:52.234458 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03249759-f246-46c8-815b-345069a0f295 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:52.236412 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e410ca-1f71-4884-bad6-b1de25f126d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:52.237049 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e410ca-1f71-4884-bad6-b1de25f126d9 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:52.237582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e410ca-1f71-4884-bad6-b1de25f126d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:52.237955 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e410ca-1f71-4884-bad6-b1de25f126d9 None admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:52.239654 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e410ca-1f71-4884-bad6-b1de25f126d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:52.239967 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e410ca-1f71-4884-bad6-b1de25f126d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:52.241449 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e410ca-1f71-4884-bad6-b1de25f126d9 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:52.261816 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 281/581] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 15:05:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:52.264291 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e410ca-1f71-4884-bad6-b1de25f126d9 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:52.362563 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03249759-f246-46c8-815b-345069a0f295 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:52.377138 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:52.397359 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e410ca-1f71-4884-bad6-b1de25f126d9 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:52.408034 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61990f90-7d8b-4414-81ae-036888de07a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:52.408704 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61990f90-7d8b-4414-81ae-036888de07a2 None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:52.408981 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61990f90-7d8b-4414-81ae-036888de07a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:52.409276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61990f90-7d8b-4414-81ae-036888de07a2 None admin] PATH_INFO: `/v3/projects/1fd85e9620ea42a69363d006d715ad04/users/2f4a48b97bf9405eb44f593c41fe1e4d/roles/008dc5c4798945a8bc61788f87211b2a` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:52.429378 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61990f90-7d8b-4414-81ae-036888de07a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fd85e9620ea42a69363d006d715ad04, user_id=2f4a48b97bf9405eb44f593c41fe1e4d, role_id=008dc5c4798945a8bc61788f87211b2a)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:52.431667 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61990f90-7d8b-4414-81ae-036888de07a2 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:52.434971 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124ca7f-13db-43bd-ab52-25dfc83fe5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:52.436256 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124ca7f-13db-43bd-ab52-25dfc83fe5f7 None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:52.436460 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124ca7f-13db-43bd-ab52-25dfc83fe5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:52.436746 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124ca7f-13db-43bd-ab52-25dfc83fe5f7 None admin] PATH_INFO: `/v3/projects/1fd85e9620ea42a69363d006d715ad04/users/8098c9c25a384b33885bbe6bcaaf01a8/roles/008dc5c4798945a8bc61788f87211b2a` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:52.448029 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 301/582] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 15:05:52 2022] PUT /identity/v3/projects/1fd85e9620ea42a69363d006d715ad04/users/2f4a48b97bf9405eb44f593c41fe1e4d/roles/008dc5c4798945a8bc61788f87211b2a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:05:52.462254 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124ca7f-13db-43bd-ab52-25dfc83fe5f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fd85e9620ea42a69363d006d715ad04, user_id=8098c9c25a384b33885bbe6bcaaf01a8, role_id=008dc5c4798945a8bc61788f87211b2a)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:52.463733 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124ca7f-13db-43bd-ab52-25dfc83fe5f7 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:52.480199 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 282/583] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 15:05:52 2022] PUT /identity/v3/projects/1fd85e9620ea42a69363d006d715ad04/users/8098c9c25a384b33885bbe6bcaaf01a8/roles/008dc5c4798945a8bc61788f87211b2a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:05:53.559022 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b207f-c613-42a8-8f96-78ef58c5201d None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:53.559606 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b207f-c613-42a8-8f96-78ef58c5201d None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:53.559606 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b207f-c613-42a8-8f96-78ef58c5201d None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:53.561216 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 302/584] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:53.567549 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e323581-fe30-452a-9d33-8215af659a82 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:53.568090 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e323581-fe30-452a-9d33-8215af659a82 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:53.568090 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e323581-fe30-452a-9d33-8215af659a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:53.587739 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-9e323581-fe30-452a-9d33-8215af659a82 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:53.588938 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-9e323581-fe30-452a-9d33-8215af659a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:53.591801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:53.656383 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 283/585] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:53.977682 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b207f-c613-42a8-8f96-78ef58c5201d None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:54.086740 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b207f-c613-42a8-8f96-78ef58c5201d None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:54.123006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e24db2-4cbf-4dc4-a68d-2489ce435ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:54.124127 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e24db2-4cbf-4dc4-a68d-2489ce435ff1 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:54.124600 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e24db2-4cbf-4dc4-a68d-2489ce435ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:54.125089 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e24db2-4cbf-4dc4-a68d-2489ce435ff1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:54.135578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e24db2-4cbf-4dc4-a68d-2489ce435ff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:54.140671 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-f5e24db2-4cbf-4dc4-a68d-2489ce435ff1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:54.140671 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:54.140671 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:54.140671 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:54.140671 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:54.140671 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:54.140671 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:54.140671 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:54.140671 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:54.140671 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:54.140671 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:54.140671 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:54.140671 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:54.140671 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:54.140671 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:54.140671 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:54.141595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:54.141595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:54.141595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:54.141595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:54.141595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:54.141595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:54.141595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:54.141595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:54.141595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:54.141595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:54.141595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:54.141595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:54.141595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:54.141595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:54.141595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:54.141595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:54.142482 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:54.142482 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:54.142482 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:54.142482 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:54.142482 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:54.142482 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:54.142482 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:54.142482 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:54.142482 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:54.142482 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:54.142482 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:54.142482 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:54.145115 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 303/586] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 15:05:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:54.151122 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e323581-fe30-452a-9d33-8215af659a82 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:54.251507 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e323581-fe30-452a-9d33-8215af659a82 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:54.285586 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23857b0f-4492-409d-ba6c-37d85ae27ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:54.286237 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23857b0f-4492-409d-ba6c-37d85ae27ab6 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:54.286510 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23857b0f-4492-409d-ba6c-37d85ae27ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:54.286775 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23857b0f-4492-409d-ba6c-37d85ae27ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:54.287426 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23857b0f-4492-409d-ba6c-37d85ae27ab6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:54.287723 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23857b0f-4492-409d-ba6c-37d85ae27ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:54.289216 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23857b0f-4492-409d-ba6c-37d85ae27ab6 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:54.297866 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 284/587] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 15:05:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:54.303490 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e24db2-4cbf-4dc4-a68d-2489ce435ff1 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:54.330210 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:54.412905 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e24db2-4cbf-4dc4-a68d-2489ce435ff1 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:54.447313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc9830-f593-4a60-8602-04855a33f9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:54.447941 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc9830-f593-4a60-8602-04855a33f9b6 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:54.448212 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc9830-f593-4a60-8602-04855a33f9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:54.448477 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc9830-f593-4a60-8602-04855a33f9b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:54.458576 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc9830-f593-4a60-8602-04855a33f9b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:54.460021 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc9830-f593-4a60-8602-04855a33f9b6 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:54.474951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-98dc9830-f593-4a60-8602-04855a33f9b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:54.474951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:54.474951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:54.474951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:54.474951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:54.474951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:54.474951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:54.474951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:54.474951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:54.474951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:54.474951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:54.474951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:54.474951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:54.474951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:54.474951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:54.474951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:54.475950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:54.475950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:54.475950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:54.475950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:54.475950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:54.475950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:54.475950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:54.475950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:54.475950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:54.475950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:54.475950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:54.475950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:54.475950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:54.475950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:54.475950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:54.475950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:54.475950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:54.476898 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:54.476898 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:54.476898 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:54.476898 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 304/588] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:54.483514 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23857b0f-4492-409d-ba6c-37d85ae27ab6 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:54.506159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:54.506467 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603750e4-3274-4c53-8666-e9018dd43a60 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:54.506657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603750e4-3274-4c53-8666-e9018dd43a60 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:54.507141 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603750e4-3274-4c53-8666-e9018dd43a60 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:54.508577 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 305/589] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:54.516531 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a61f7-f0d8-41bf-a198-448f3ae516e2 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:54.517404 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a61f7-f0d8-41bf-a198-448f3ae516e2 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:54.517916 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a61f7-f0d8-41bf-a198-448f3ae516e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:54.540821 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-169a61f7-f0d8-41bf-a198-448f3ae516e2 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:54.542516 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-169a61f7-f0d8-41bf-a198-448f3ae516e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:54.605603 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23857b0f-4492-409d-ba6c-37d85ae27ab6 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:54.641539 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 306/590] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:05:54.651742 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797c5dc-45c8-497c-b70a-ba09b400f976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:54.652567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797c5dc-45c8-497c-b70a-ba09b400f976 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:54.652978 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797c5dc-45c8-497c-b70a-ba09b400f976 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:54.653400 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797c5dc-45c8-497c-b70a-ba09b400f976 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:54.654264 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797c5dc-45c8-497c-b70a-ba09b400f976 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:54.654764 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797c5dc-45c8-497c-b70a-ba09b400f976 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:54.656283 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797c5dc-45c8-497c-b70a-ba09b400f976 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:54.668907 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 285/591] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:54.675620 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a61f7-f0d8-41bf-a198-448f3ae516e2 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:54.676835 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:54.786228 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a61f7-f0d8-41bf-a198-448f3ae516e2 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:54.821294 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6692ba1-5e24-40b0-af67-7348b6c0ba98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:54.822298 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6692ba1-5e24-40b0-af67-7348b6c0ba98 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:54.822764 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6692ba1-5e24-40b0-af67-7348b6c0ba98 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:54.823234 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6692ba1-5e24-40b0-af67-7348b6c0ba98 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:54.830801 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6692ba1-5e24-40b0-af67-7348b6c0ba98 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:54.832490 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6692ba1-5e24-40b0-af67-7348b6c0ba98 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:54.844357 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-f6692ba1-5e24-40b0-af67-7348b6c0ba98 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:05:54.844357 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:54.844357 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:54.844357 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:54.844357 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:54.844357 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:54.844357 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:54.844357 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:54.844357 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:54.844357 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:54.844357 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:54.844357 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:54.844357 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:05:54.844357 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:05:54.844357 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:05:54.844357 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:05:54.845377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:54.845377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:54.845377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:05:54.845377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:54.845377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:05:54.845377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:54.845377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:54.845377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:54.845377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:54.845377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:54.845377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:54.845377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:54.845377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:54.845377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:54.845377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:54.845377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:54.845377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:54.845377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:54.846346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:54.846346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:54.846346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:05:54.846346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:05:54.846346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:05:54.846346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:05:54.846346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:05:54.846346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:05:54.846346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:05:54.846346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:54.848748 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 307/592] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Sep 23 15:05:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:54.854091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797c5dc-45c8-497c-b70a-ba09b400f976 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:54.915438 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:54.933209 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ea7e9-ffb0-4c9a-8bdc-166057f5b7f9 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:54.933513 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ea7e9-ffb0-4c9a-8bdc-166057f5b7f9 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:54.933963 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ea7e9-ffb0-4c9a-8bdc-166057f5b7f9 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:54.935638 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 308/593] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:54.940468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd817a3a-2c84-46ec-adce-ff7da20a5c81 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:54.940747 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd817a3a-2c84-46ec-adce-ff7da20a5c81 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:54.941018 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd817a3a-2c84-46ec-adce-ff7da20a5c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:54.959145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797c5dc-45c8-497c-b70a-ba09b400f976 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:54.960282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-cd817a3a-2c84-46ec-adce-ff7da20a5c81 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:54.962636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-cd817a3a-2c84-46ec-adce-ff7da20a5c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:54.997202 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47289a67-92f5-4d01-b776-4a59184d66c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:54.997945 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47289a67-92f5-4d01-b776-4a59184d66c1 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:54.998312 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47289a67-92f5-4d01-b776-4a59184d66c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:54.998595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47289a67-92f5-4d01-b776-4a59184d66c1 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:54.999316 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47289a67-92f5-4d01-b776-4a59184d66c1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:54.999619 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47289a67-92f5-4d01-b776-4a59184d66c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:55.001052 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47289a67-92f5-4d01-b776-4a59184d66c1 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:55.019987 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 286/594] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Sep 23 15:05:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:55.020800 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47289a67-92f5-4d01-b776-4a59184d66c1 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:55.031527 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:55.044094 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 309/595] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:05:55.044696 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd817a3a-2c84-46ec-adce-ff7da20a5c81 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:55.128789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47289a67-92f5-4d01-b776-4a59184d66c1 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:55.148135 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:55.154429 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd817a3a-2c84-46ec-adce-ff7da20a5c81 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:55.162072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecff0d6-97a7-4a40-a82c-fa1ec4c400e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:55.162701 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecff0d6-97a7-4a40-a82c-fa1ec4c400e8 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:55.162974 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecff0d6-97a7-4a40-a82c-fa1ec4c400e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:55.163240 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecff0d6-97a7-4a40-a82c-fa1ec4c400e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:55.172990 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecff0d6-97a7-4a40-a82c-fa1ec4c400e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:55.177753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-2ecff0d6-97a7-4a40-a82c-fa1ec4c400e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:55.177753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:55.177753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:55.177753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:55.177753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:55.177753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:55.177753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:55.177753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:55.177753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:55.177753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:55.177753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:55.177753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:55.177753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:55.177753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:55.177753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:55.177753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:55.178669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:55.178669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:55.178669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:55.178669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:55.178669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:55.178669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:55.178669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:55.178669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:55.178669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:55.178669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:55.178669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:55.178669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:55.178669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:55.178669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:55.178669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:55.178669 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:55.179519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:55.179519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:55.179519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:55.179519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:55.179519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:55.179519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:55.179519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:55.179519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:55.179519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:55.179519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:55.179519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:55.179519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:55.179519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 287/596] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 15:05:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:55.180252 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76ced8-44b8-4a67-9d35-ba944d9f1ec4 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:55.180639 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76ced8-44b8-4a67-9d35-ba944d9f1ec4 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:55.180639 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76ced8-44b8-4a67-9d35-ba944d9f1ec4 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:55.182515 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 288/597] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:55.186518 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76ced8-44b8-4a67-9d35-ba944d9f1ec4 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:55.197921 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa56784-d2f0-4fc1-82ff-daa99e6c6933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:55.198878 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa56784-d2f0-4fc1-82ff-daa99e6c6933 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:55.199359 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa56784-d2f0-4fc1-82ff-daa99e6c6933 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:55.199804 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa56784-d2f0-4fc1-82ff-daa99e6c6933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:55.260507 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:55.270855 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa56784-d2f0-4fc1-82ff-daa99e6c6933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:55.272305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa56784-d2f0-4fc1-82ff-daa99e6c6933 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:55.288530 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76ced8-44b8-4a67-9d35-ba944d9f1ec4 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:55.326315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0398e1-479a-40e3-8a49-341e427dc998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:55.326923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0398e1-479a-40e3-8a49-341e427dc998 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:55.327200 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0398e1-479a-40e3-8a49-341e427dc998 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:55.327471 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0398e1-479a-40e3-8a49-341e427dc998 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:55.328129 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0398e1-479a-40e3-8a49-341e427dc998 None admin] RBAC: Adding query filter params (name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:55.328428 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0398e1-479a-40e3-8a49-341e427dc998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:55.329808 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0398e1-479a-40e3-8a49-341e427dc998 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:55.338548 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 289/598] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 15:05:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:55.346089 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87b4bc-af0c-46fb-8853-00616f1b28e1 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:55.346433 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87b4bc-af0c-46fb-8853-00616f1b28e1 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:55.346691 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87b4bc-af0c-46fb-8853-00616f1b28e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:55.367207 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-9f87b4bc-af0c-46fb-8853-00616f1b28e1 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:55.368845 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-9f87b4bc-af0c-46fb-8853-00616f1b28e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:55.373393 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 310/599] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:55.374324 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa56784-d2f0-4fc1-82ff-daa99e6c6933 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:55.418776 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:55.452369 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 290/600] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:55.453206 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87b4bc-af0c-46fb-8853-00616f1b28e1 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:55.476956 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:55.486788 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa56784-d2f0-4fc1-82ff-daa99e6c6933 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:55.520763 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882049cf-7c9b-45c6-9a5e-be8595b1466e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:55.521382 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882049cf-7c9b-45c6-9a5e-be8595b1466e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:55.521653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882049cf-7c9b-45c6-9a5e-be8595b1466e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:55.521946 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882049cf-7c9b-45c6-9a5e-be8595b1466e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:55.531827 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882049cf-7c9b-45c6-9a5e-be8595b1466e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:55.533273 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882049cf-7c9b-45c6-9a5e-be8595b1466e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:55.548180 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-882049cf-7c9b-45c6-9a5e-be8595b1466e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:55.548180 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:55.548180 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:55.548180 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:55.548180 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:55.548180 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:55.548180 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:55.548180 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:55.548180 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:55.548180 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:55.548180 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:55.548180 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:55.548180 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:55.548180 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:55.548180 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:55.548180 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:55.549147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:55.549147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:55.549147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:55.549147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:55.549147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:55.549147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:55.549147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:55.549147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:55.549147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:55.549147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:55.549147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:55.549147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:55.549147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:55.549147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:55.549147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:55.549147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:55.549147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:55.555235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:55.555235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:55.555235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:55.555235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 311/601] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:55.555235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882049cf-7c9b-45c6-9a5e-be8595b1466e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:55.562935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87b4bc-af0c-46fb-8853-00616f1b28e1 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:55.597267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bfeaf-4188-49d5-be9e-522e21abb4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:55.597868 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bfeaf-4188-49d5-be9e-522e21abb4c2 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:55.598147 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bfeaf-4188-49d5-be9e-522e21abb4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:55.598415 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bfeaf-4188-49d5-be9e-522e21abb4c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:55.609169 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bfeaf-4188-49d5-be9e-522e21abb4c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:55.614036 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-6a3bfeaf-4188-49d5-be9e-522e21abb4c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:55.614036 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:55.614036 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:55.614036 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:55.614036 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:55.614036 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:55.614036 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:55.614036 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:55.614036 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:55.614036 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:55.614036 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:55.614036 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:55.614036 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:55.614036 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:55.614036 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:55.614036 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:55.615021 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:55.615021 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:55.615021 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:55.615021 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:55.615021 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:55.615021 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:55.615021 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:55.615021 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:55.615021 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:55.615021 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:55.615021 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:55.615021 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:55.615021 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:55.615021 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:55.615021 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:55.615021 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:55.615884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:55.615884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:55.615884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:55.615884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:55.615884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:55.615884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:55.615884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:55.615884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:55.615884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:55.615884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:55.615884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:55.615884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:55.615884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 291/602] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 15:05:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:55.615884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bfeaf-4188-49d5-be9e-522e21abb4c2 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:55.650484 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:55.662499 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882049cf-7c9b-45c6-9a5e-be8595b1466e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:55.697006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34bda2-5cc4-4cee-9e5e-40842347621a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:55.697634 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34bda2-5cc4-4cee-9e5e-40842347621a None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:55.697949 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34bda2-5cc4-4cee-9e5e-40842347621a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:55.698244 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34bda2-5cc4-4cee-9e5e-40842347621a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:55.709732 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34bda2-5cc4-4cee-9e5e-40842347621a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:55.711228 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34bda2-5cc4-4cee-9e5e-40842347621a None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:55.714464 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:55.730993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-1f34bda2-5cc4-4cee-9e5e-40842347621a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:55.730993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:55.730993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:55.730993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:55.730993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:55.730993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:55.730993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:55.730993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:55.730993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:55.730993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:55.730993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:55.730993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:55.730993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:55.730993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:55.730993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:55.730993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:55.732501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:55.732501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:55.732501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:55.732501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:55.732501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:55.732501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:55.732501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:55.732501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:55.732501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:55.732501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:55.732501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:55.732501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:55.732501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:55.732501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:55.732501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:55.732501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:55.732501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:55.733657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:55.733657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:55.733657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:55.738880 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bfeaf-4188-49d5-be9e-522e21abb4c2 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:55.740152 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 312/603] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:55.741225 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34bda2-5cc4-4cee-9e5e-40842347621a None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:55.775998 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655e187-034d-4c0e-876f-0783f3f75645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:55.776614 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655e187-034d-4c0e-876f-0783f3f75645 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:55.776887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655e187-034d-4c0e-876f-0783f3f75645 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:55.777157 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655e187-034d-4c0e-876f-0783f3f75645 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:55.777834 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655e187-034d-4c0e-876f-0783f3f75645 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:55.778135 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655e187-034d-4c0e-876f-0783f3f75645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:55.779503 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655e187-034d-4c0e-876f-0783f3f75645 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:55.791599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 292/604] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:55.792396 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655e187-034d-4c0e-876f-0783f3f75645 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:55.856998 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34bda2-5cc4-4cee-9e5e-40842347621a None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:55.887716 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:55.891187 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2785b-56ba-4ffa-a10c-75df6d1ff267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:55.891769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2785b-56ba-4ffa-a10c-75df6d1ff267 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:55.892057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2785b-56ba-4ffa-a10c-75df6d1ff267 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:55.892320 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2785b-56ba-4ffa-a10c-75df6d1ff267 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:55.892991 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2785b-56ba-4ffa-a10c-75df6d1ff267 None admin] RBAC: Adding query filter params (name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:55.893274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2785b-56ba-4ffa-a10c-75df6d1ff267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:55.894655 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2785b-56ba-4ffa-a10c-75df6d1ff267 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:55.896825 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655e187-034d-4c0e-876f-0783f3f75645 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:55.902385 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 313/605] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 15:05:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:55.903147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2785b-56ba-4ffa-a10c-75df6d1ff267 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:55.933678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fc4f3-4bba-48a2-9d9d-c983c5feef76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:55.934302 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fc4f3-4bba-48a2-9d9d-c983c5feef76 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:55.934572 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fc4f3-4bba-48a2-9d9d-c983c5feef76 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:55.934834 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fc4f3-4bba-48a2-9d9d-c983c5feef76 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:55.935452 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fc4f3-4bba-48a2-9d9d-c983c5feef76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:55.935746 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fc4f3-4bba-48a2-9d9d-c983c5feef76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:55.937098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fc4f3-4bba-48a2-9d9d-c983c5feef76 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:55.948644 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 293/606] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:55.949481 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fc4f3-4bba-48a2-9d9d-c983c5feef76 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:55.963484 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:56.005056 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2785b-56ba-4ffa-a10c-75df6d1ff267 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:56.037285 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a53c6-dc65-489a-80ee-452480c6517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:56.037945 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a53c6-dc65-489a-80ee-452480c6517f None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:56.038219 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a53c6-dc65-489a-80ee-452480c6517f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:56.038482 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a53c6-dc65-489a-80ee-452480c6517f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:56.046677 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fc4f3-4bba-48a2-9d9d-c983c5feef76 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:56.048447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a53c6-dc65-489a-80ee-452480c6517f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:05:56.053762 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-4e5a53c6-dc65-489a-80ee-452480c6517f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:56.053762 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:56.053762 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:56.053762 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:56.053762 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:56.053762 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:56.053762 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:56.053762 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:56.053762 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:56.053762 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:56.053762 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:56.053762 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:56.053762 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:05:56.053762 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:05:56.053762 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:05:56.053762 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:05:56.054791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:05:56.054791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:05:56.054791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:05:56.054791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:05:56.054791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:56.054791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:56.054791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:56.054791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:56.054791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:56.054791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:56.054791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:56.054791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:56.054791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:56.054791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:56.054791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:56.054791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:56.055937 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:56.055937 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:56.055937 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:56.055937 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:56.055937 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:05:56.055937 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:05:56.055937 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:05:56.055937 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:05:56.055937 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:05:56.055937 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:05:56.055937 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:05:56.055937 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:56.055937 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 314/607] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 15:05:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:56.055937 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a53c6-dc65-489a-80ee-452480c6517f None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:56.081215 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3b651-2208-44fc-a975-45951c3a0f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:56.081876 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3b651-2208-44fc-a975-45951c3a0f19 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:56.082151 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3b651-2208-44fc-a975-45951c3a0f19 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:56.082418 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3b651-2208-44fc-a975-45951c3a0f19 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:56.089253 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3b651-2208-44fc-a975-45951c3a0f19 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:56.090741 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3b651-2208-44fc-a975-45951c3a0f19 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:56.102061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-48f3b651-2208-44fc-a975-45951c3a0f19 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 15:05:56.102061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:56.102061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:56.102061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:56.102061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:56.102061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:56.102061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:56.102061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:56.102061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:56.102061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:56.102061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:56.102061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:56.102061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:05:56.102061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:05:56.102061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:05:56.102061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:05:56.103059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:56.103059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:56.103059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:05:56.103059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:56.103059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:05:56.103059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:56.103059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:56.103059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:56.103059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:56.103059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:56.103059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:56.103059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:56.103059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:56.103059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:56.103059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:56.103059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:56.103059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:56.103059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:56.104017 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:56.104017 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:56.104017 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:05:56.104017 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:05:56.104017 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:05:56.104017 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:05:56.104017 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:05:56.104017 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:05:56.104017 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 15:05:56.104017 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:56.104017 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 294/608] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:56.104017 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3b651-2208-44fc-a975-45951c3a0f19 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:56.119576 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:56.170117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a53c6-dc65-489a-80ee-452480c6517f None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:56.190455 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:56.207762 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3b651-2208-44fc-a975-45951c3a0f19 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:56.210025 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031bc37-fce8-4c36-afe7-f746c9dcc732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:56.210658 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031bc37-fce8-4c36-afe7-f746c9dcc732 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:56.211021 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031bc37-fce8-4c36-afe7-f746c9dcc732 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:56.211291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031bc37-fce8-4c36-afe7-f746c9dcc732 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:56.222119 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031bc37-fce8-4c36-afe7-f746c9dcc732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:56.223546 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031bc37-fce8-4c36-afe7-f746c9dcc732 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:56.237653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-7031bc37-fce8-4c36-afe7-f746c9dcc732 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:56.237653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:56.237653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:56.237653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:56.237653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:56.237653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:56.237653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:56.237653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:56.237653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:56.237653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:56.237653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:56.237653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:56.237653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:56.237653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:56.237653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:56.237653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:56.238595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:56.238595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:56.238595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:56.238595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:56.238595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:56.238595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:56.238595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:56.238595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:56.238595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:56.238595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:56.238595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:56.238595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:56.238595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:56.238595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:56.238595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:56.238595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:56.238595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:56.239490 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:56.239490 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:56.239490 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:56.239490 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 315/609] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:56.239490 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031bc37-fce8-4c36-afe7-f746c9dcc732 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:56.246420 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901164e-eb0a-4065-a9c9-ad256d7ec016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:56.247056 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901164e-eb0a-4065-a9c9-ad256d7ec016 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:56.247328 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901164e-eb0a-4065-a9c9-ad256d7ec016 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:56.247594 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901164e-eb0a-4065-a9c9-ad256d7ec016 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:56.254408 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901164e-eb0a-4065-a9c9-ad256d7ec016 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:56.255846 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901164e-eb0a-4065-a9c9-ad256d7ec016 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:56.266976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-d901164e-eb0a-4065-a9c9-ad256d7ec016 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:56.266976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:56.266976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:56.266976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:56.266976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:56.266976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:56.266976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:56.266976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:56.266976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:56.266976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:56.266976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:56.266976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:56.266976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:05:56.266976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:05:56.266976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:05:56.267875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:05:56.267875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:56.267875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:56.267875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:56.267875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:56.267875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:56.267875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:56.267875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:56.267875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:56.267875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:56.267875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:56.267875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:56.267875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:56.267875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:56.267875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:56.267875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:56.267875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:56.268883 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:05:56.268883 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:05:56.268883 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:05:56.268883 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:05:56.268883 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:05:56.268883 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:05:56.268883 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:56.268883 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:56.268883 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 295/610] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:05:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:56.269381 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901164e-eb0a-4065-a9c9-ad256d7ec016 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:56.338342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031bc37-fce8-4c36-afe7-f746c9dcc732 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:56.341983 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:56.371371 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688eab9-6428-45d7-bd6c-ca66b36b2785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:56.371905 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688eab9-6428-45d7-bd6c-ca66b36b2785 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:56.372175 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688eab9-6428-45d7-bd6c-ca66b36b2785 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:56.372466 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688eab9-6428-45d7-bd6c-ca66b36b2785 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:56.372742 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901164e-eb0a-4065-a9c9-ad256d7ec016 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:56.373103 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688eab9-6428-45d7-bd6c-ca66b36b2785 None admin] RBAC: Adding query filter params (name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:56.373392 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688eab9-6428-45d7-bd6c-ca66b36b2785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:56.374837 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688eab9-6428-45d7-bd6c-ca66b36b2785 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:56.382806 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 316/611] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 15:05:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:56.383549 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688eab9-6428-45d7-bd6c-ca66b36b2785 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:56.406947 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1bc08-4916-4234-8310-3a4470ab84e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:56.407552 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1bc08-4916-4234-8310-3a4470ab84e9 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:56.407820 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1bc08-4916-4234-8310-3a4470ab84e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:56.408083 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1bc08-4916-4234-8310-3a4470ab84e9 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:56.408796 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1bc08-4916-4234-8310-3a4470ab84e9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:56.409095 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1bc08-4916-4234-8310-3a4470ab84e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:56.410548 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1bc08-4916-4234-8310-3a4470ab84e9 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:56.415817 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:56.427426 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 296/612] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Sep 23 15:05:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:56.428202 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1bc08-4916-4234-8310-3a4470ab84e9 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:56.488085 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688eab9-6428-45d7-bd6c-ca66b36b2785 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:56.521576 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d6d99-0171-4435-8f2d-82794bdf4dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:56.522199 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d6d99-0171-4435-8f2d-82794bdf4dcc None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:56.522475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d6d99-0171-4435-8f2d-82794bdf4dcc None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:56.522739 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d6d99-0171-4435-8f2d-82794bdf4dcc None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:56.523392 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d6d99-0171-4435-8f2d-82794bdf4dcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:56.523685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d6d99-0171-4435-8f2d-82794bdf4dcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:56.525060 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d6d99-0171-4435-8f2d-82794bdf4dcc None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:56.532043 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1bc08-4916-4234-8310-3a4470ab84e9 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:56.536416 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 317/613] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:56.537094 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d6d99-0171-4435-8f2d-82794bdf4dcc None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:56.560476 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:56.566844 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d1752-b2df-4572-90b1-4443da2814f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:56.567448 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d1752-b2df-4572-90b1-4443da2814f1 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:56.567718 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d1752-b2df-4572-90b1-4443da2814f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:56.567983 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d1752-b2df-4572-90b1-4443da2814f1 None admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:56.568659 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d1752-b2df-4572-90b1-4443da2814f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:56.568955 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d1752-b2df-4572-90b1-4443da2814f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:56.570446 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d1752-b2df-4572-90b1-4443da2814f1 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:56.581440 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 297/614] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 15:05:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:56.582243 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d1752-b2df-4572-90b1-4443da2814f1 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:56.631431 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:56.641013 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d6d99-0171-4435-8f2d-82794bdf4dcc None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:56.673447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc9fd8-49b6-4c87-ae94-e32fccfec029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:56.674082 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc9fd8-49b6-4c87-ae94-e32fccfec029 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:56.674356 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc9fd8-49b6-4c87-ae94-e32fccfec029 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:56.674616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc9fd8-49b6-4c87-ae94-e32fccfec029 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:56.682852 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d1752-b2df-4572-90b1-4443da2814f1 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:56.684374 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc9fd8-49b6-4c87-ae94-e32fccfec029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:56.685834 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc9fd8-49b6-4c87-ae94-e32fccfec029 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:56.699760 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-f8bc9fd8-49b6-4c87-ae94-e32fccfec029 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:56.699760 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:56.699760 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:56.699760 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:56.699760 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:56.699760 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:56.699760 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:56.699760 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:56.699760 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:56.699760 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:56.699760 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:56.699760 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:56.699760 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:56.699760 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:56.699760 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:56.699760 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:56.705377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:56.705377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:56.705377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:56.705377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:56.705377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:56.705377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:56.705377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:56.705377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:56.705377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:56.705377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:56.705377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:56.705377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:56.705377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:56.705377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:56.705377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:56.705377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:56.705377 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:56.706539 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:56.706539 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:56.706539 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:56.706539 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 318/615] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:56.706539 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc9fd8-49b6-4c87-ae94-e32fccfec029 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:56.719131 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c8fad-1af7-4a74-925d-f1efef2ba6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:56.719762 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c8fad-1af7-4a74-925d-f1efef2ba6cf None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:56.720039 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c8fad-1af7-4a74-925d-f1efef2ba6cf None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:56.720363 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c8fad-1af7-4a74-925d-f1efef2ba6cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:56.779069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:56.790090 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c8fad-1af7-4a74-925d-f1efef2ba6cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:56.791538 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c8fad-1af7-4a74-925d-f1efef2ba6cf None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:56.803845 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc9fd8-49b6-4c87-ae94-e32fccfec029 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:56.838089 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283d89c-8c06-4b8f-8e26-808376832e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:56.838718 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283d89c-8c06-4b8f-8e26-808376832e7a None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:56.838995 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283d89c-8c06-4b8f-8e26-808376832e7a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:56.839296 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283d89c-8c06-4b8f-8e26-808376832e7a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:56.847540 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283d89c-8c06-4b8f-8e26-808376832e7a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:56.848991 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283d89c-8c06-4b8f-8e26-808376832e7a None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:56.860356 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-5283d89c-8c06-4b8f-8e26-808376832e7a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 15:05:56.860356 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:56.860356 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:56.860356 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:56.860356 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:56.860356 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:56.860356 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:56.860356 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:56.860356 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:56.860356 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:56.860356 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:56.860356 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:56.860356 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:05:56.860356 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:05:56.860356 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:05:56.860356 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:05:56.861533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:56.861533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:56.861533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:05:56.861533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:56.861533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:05:56.861533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:56.861533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:56.861533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:56.861533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:56.861533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:56.861533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:56.861533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:56.861533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:56.861533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:56.861533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:56.861533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:56.861533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:56.861533 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:56.862544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:56.862544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:56.862544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:05:56.862544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:05:56.862544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:05:56.862544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:05:56.862544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:05:56.862544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:05:56.862544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 15:05:56.862544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:56.862544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 319/616] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 15:05:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:56.862544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283d89c-8c06-4b8f-8e26-808376832e7a None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:56.867957 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:56.889909 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 298/617] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:56.890672 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c8fad-1af7-4a74-925d-f1efef2ba6cf None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:56.963000 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283d89c-8c06-4b8f-8e26-808376832e7a None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:56.976715 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:56.987221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c8fad-1af7-4a74-925d-f1efef2ba6cf None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:56.997242 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d85ff-09ef-4fc8-98f8-f9bdcf9dd725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:56.997870 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d85ff-09ef-4fc8-98f8-f9bdcf9dd725 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:56.998145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d85ff-09ef-4fc8-98f8-f9bdcf9dd725 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:56.998415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d85ff-09ef-4fc8-98f8-f9bdcf9dd725 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:56.999416 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d85ff-09ef-4fc8-98f8-f9bdcf9dd725 None admin] RBAC: Adding query filter params (role.id=008dc5c4798945a8bc61788f87211b2a, scope.project.id=1fd85e9620ea42a69363d006d715ad04, user.id=542c7a84dd044588a42a9e3414cab516) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:56.999719 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d85ff-09ef-4fc8-98f8-f9bdcf9dd725 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:57.001155 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d85ff-09ef-4fc8-98f8-f9bdcf9dd725 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:57.006694 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 320/618] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:05:56 2022] GET /identity/v3/role_assignments?user.id=542c7a84dd044588a42a9e3414cab516&scope.project.id=1fd85e9620ea42a69363d006d715ad04&role.id=008dc5c4798945a8bc61788f87211b2a => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:57.007443 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d85ff-09ef-4fc8-98f8-f9bdcf9dd725 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:57.025521 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46f11f-e290-4bc8-b44e-a36707c735b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:57.026189 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46f11f-e290-4bc8-b44e-a36707c735b6 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:57.026466 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46f11f-e290-4bc8-b44e-a36707c735b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:57.026845 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46f11f-e290-4bc8-b44e-a36707c735b6 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:57.027375 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46f11f-e290-4bc8-b44e-a36707c735b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:57.027880 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46f11f-e290-4bc8-b44e-a36707c735b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:57.029108 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46f11f-e290-4bc8-b44e-a36707c735b6 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:57.042934 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 299/619] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:57.043981 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46f11f-e290-4bc8-b44e-a36707c735b6 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:57.086321 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:57.126621 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d85ff-09ef-4fc8-98f8-f9bdcf9dd725 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:57.155207 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46f11f-e290-4bc8-b44e-a36707c735b6 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:57.167210 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9ed9b-cb10-4242-b0cb-a8c8d0436174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:57.167845 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9ed9b-cb10-4242-b0cb-a8c8d0436174 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:57.168105 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9ed9b-cb10-4242-b0cb-a8c8d0436174 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:57.168388 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9ed9b-cb10-4242-b0cb-a8c8d0436174 None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:57.169099 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9ed9b-cb10-4242-b0cb-a8c8d0436174 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:57.169400 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9ed9b-cb10-4242-b0cb-a8c8d0436174 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:57.171170 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9ed9b-cb10-4242-b0cb-a8c8d0436174 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:57.191715 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d568a-5b65-4382-8f58-ba39d6761a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:57.196954 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d568a-5b65-4382-8f58-ba39d6761a33 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:57.197144 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 321/620] 10.222.0.48 () {56 vars in 1139 bytes} [Fri Sep 23 15:05:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:57.197272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d568a-5b65-4382-8f58-ba39d6761a33 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:57.197272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d568a-5b65-4382-8f58-ba39d6761a33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:57.197543 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9ed9b-cb10-4242-b0cb-a8c8d0436174 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:57.208842 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d568a-5b65-4382-8f58-ba39d6761a33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:57.210376 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d568a-5b65-4382-8f58-ba39d6761a33 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:57.226964 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-6a7d568a-5b65-4382-8f58-ba39d6761a33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:57.226964 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:57.226964 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:57.226964 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:57.226964 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:57.226964 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:57.226964 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:57.226964 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:57.226964 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:57.226964 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:57.226964 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:57.226964 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:57.226964 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:57.226964 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:57.226964 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:57.226964 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:57.227993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:57.227993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:57.227993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:57.227993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:57.227993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:57.227993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:57.227993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:57.227993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:57.227993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:57.227993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:57.227993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:57.227993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:57.227993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:57.227993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:57.227993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:57.227993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:57.227993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:57.229056 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:57.229056 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:57.229056 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:57.229056 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 300/621] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:57.229056 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d568a-5b65-4382-8f58-ba39d6761a33 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:57.231858 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:57.315678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9ed9b-cb10-4242-b0cb-a8c8d0436174 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:57.343278 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:57.343462 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d568a-5b65-4382-8f58-ba39d6761a33 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:57.354596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d7c5e-ed64-4477-bd03-d78cc8068aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:57.355301 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d7c5e-ed64-4477-bd03-d78cc8068aca None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:57.355653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d7c5e-ed64-4477-bd03-d78cc8068aca None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:57.355985 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d7c5e-ed64-4477-bd03-d78cc8068aca None admin] PATH_INFO: `/v3/users/glance` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:57.364016 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d7c5e-ed64-4477-bd03-d78cc8068aca None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:57.365588 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d7c5e-ed64-4477-bd03-d78cc8068aca None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:57.378121 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-6c1d7c5e-ed64-4477-bd03-d78cc8068aca None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 23 15:05:57.378121 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:57.378121 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:57.378121 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:57.378121 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:57.378121 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:57.378121 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:57.378121 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:57.378121 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:57.378121 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:57.378121 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:57.378121 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:57.378121 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:05:57.378121 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:05:57.378121 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:05:57.378121 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:05:57.379291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:57.379291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:57.379291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:05:57.379291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:57.379291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:05:57.379291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:05:57.379291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:57.379291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:57.379291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:57.379291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:57.379291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:57.379291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:57.379291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:57.379291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:57.379291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:57.379291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:57.379291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:57.379291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:57.380505 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:57.380505 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:57.380505 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:05:57.380505 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:05:57.380505 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:05:57.380505 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:05:57.380505 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:05:57.380505 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:05:57.380505 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 23 15:05:57.380505 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:57.381184 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957870a-9db1-4467-9875-7f2b16c728d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:57.381184 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957870a-9db1-4467-9875-7f2b16c728d4 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:57.381184 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957870a-9db1-4467-9875-7f2b16c728d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:57.381431 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 322/622] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:05:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:57.381791 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957870a-9db1-4467-9875-7f2b16c728d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:57.381892 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d7c5e-ed64-4477-bd03-d78cc8068aca None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:57.450869 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957870a-9db1-4467-9875-7f2b16c728d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:57.452266 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957870a-9db1-4467-9875-7f2b16c728d4 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:57.454094 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:57.484189 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d7c5e-ed64-4477-bd03-d78cc8068aca None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:57.522786 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a368e-5992-4bce-bfa3-f3b9c0cf7ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:57.523552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a368e-5992-4bce-bfa3-f3b9c0cf7ff6 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:57.523910 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a368e-5992-4bce-bfa3-f3b9c0cf7ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:57.524178 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a368e-5992-4bce-bfa3-f3b9c0cf7ff6 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:57.524816 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a368e-5992-4bce-bfa3-f3b9c0cf7ff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:57.525103 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a368e-5992-4bce-bfa3-f3b9c0cf7ff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:57.526671 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a368e-5992-4bce-bfa3-f3b9c0cf7ff6 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:57.543407 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 323/623] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:57.543407 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a368e-5992-4bce-bfa3-f3b9c0cf7ff6 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:57.565870 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 301/624] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:57.566717 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957870a-9db1-4467-9875-7f2b16c728d4 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:57.597104 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:57.652626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a368e-5992-4bce-bfa3-f3b9c0cf7ff6 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:57.681920 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957870a-9db1-4467-9875-7f2b16c728d4 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:57.683979 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:57.687721 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739bbd3-f19b-4ef4-9901-5fbcfadae2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:57.688331 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739bbd3-f19b-4ef4-9901-5fbcfadae2f0 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:57.688599 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739bbd3-f19b-4ef4-9901-5fbcfadae2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:57.688857 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739bbd3-f19b-4ef4-9901-5fbcfadae2f0 None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:57.689568 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739bbd3-f19b-4ef4-9901-5fbcfadae2f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:57.689894 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739bbd3-f19b-4ef4-9901-5fbcfadae2f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:57.691324 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739bbd3-f19b-4ef4-9901-5fbcfadae2f0 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:57.710192 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 324/625] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Sep 23 15:05:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:57.711029 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739bbd3-f19b-4ef4-9901-5fbcfadae2f0 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:57.734159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c2811-c4c6-4482-bfda-112d587b7b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:57.734906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c2811-c4c6-4482-bfda-112d587b7b30 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:57.735181 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c2811-c4c6-4482-bfda-112d587b7b30 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:57.735446 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c2811-c4c6-4482-bfda-112d587b7b30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:57.742352 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c2811-c4c6-4482-bfda-112d587b7b30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:57.743794 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c2811-c4c6-4482-bfda-112d587b7b30 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:57.755329 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-a79c2811-c4c6-4482-bfda-112d587b7b30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:57.755329 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:57.755329 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:57.755329 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:57.755329 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:57.755329 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:57.755329 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:57.755329 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:57.755329 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:57.755329 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:57.755329 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:57.755329 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:57.755329 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:05:57.755329 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:05:57.755329 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:05:57.756267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:05:57.756267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:57.756267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:57.756267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:57.756267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:57.756267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:57.756267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:57.756267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:57.756267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:57.756267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:57.756267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:57.756267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:57.756267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:57.756267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:57.756267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:57.756267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:57.756267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:57.757216 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:05:57.757216 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:05:57.757216 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:05:57.757216 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:05:57.757216 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:05:57.757216 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:05:57.757216 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:57.757216 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:57.757216 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 302/626] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:05:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:57.758507 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c2811-c4c6-4482-bfda-112d587b7b30 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:57.816228 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739bbd3-f19b-4ef4-9901-5fbcfadae2f0 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:57.818652 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:57.856875 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7779aad-f1b8-41da-a5eb-303799aa5d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:57.857500 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7779aad-f1b8-41da-a5eb-303799aa5d89 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:57.857807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7779aad-f1b8-41da-a5eb-303799aa5d89 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:57.858074 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7779aad-f1b8-41da-a5eb-303799aa5d89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:57.865159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c2811-c4c6-4482-bfda-112d587b7b30 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:57.868434 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7779aad-f1b8-41da-a5eb-303799aa5d89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:57.869921 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7779aad-f1b8-41da-a5eb-303799aa5d89 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:57.884664 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-c7779aad-f1b8-41da-a5eb-303799aa5d89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:57.884664 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:57.884664 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:57.884664 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:57.884664 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:57.884664 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:57.884664 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:57.884664 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:57.884664 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:57.884664 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:57.884664 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:57.884664 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:57.884664 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:57.884664 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:57.884664 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:57.884664 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:57.885865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:57.885865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:57.885865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:57.885865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:57.885865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:57.885865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:57.885865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:57.885865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:57.885865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:57.885865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:57.885865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:57.885865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:57.885865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:57.885865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:57.885865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:57.885865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:57.885865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:57.886947 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:57.886947 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:57.886947 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:57.890493 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 325/627] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:57.891371 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7779aad-f1b8-41da-a5eb-303799aa5d89 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:57.911683 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bca0f-fb17-4498-9446-8b7d8577760e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:57.912298 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bca0f-fb17-4498-9446-8b7d8577760e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:57.912584 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bca0f-fb17-4498-9446-8b7d8577760e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:57.912857 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bca0f-fb17-4498-9446-8b7d8577760e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:57.948984 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:57.992098 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7779aad-f1b8-41da-a5eb-303799aa5d89 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:57.994826 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bca0f-fb17-4498-9446-8b7d8577760e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:57.996195 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bca0f-fb17-4498-9446-8b7d8577760e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:58.032150 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df708cb-a82e-4fcb-ad82-aeed53f657ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:58.033068 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df708cb-a82e-4fcb-ad82-aeed53f657ec None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:58.033569 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df708cb-a82e-4fcb-ad82-aeed53f657ec None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:58.034139 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df708cb-a82e-4fcb-ad82-aeed53f657ec None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:58.035464 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df708cb-a82e-4fcb-ad82-aeed53f657ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:58.035968 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df708cb-a82e-4fcb-ad82-aeed53f657ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:58.038282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df708cb-a82e-4fcb-ad82-aeed53f657ec None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:58.050637 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 326/628] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 15:05:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:58.055731 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df708cb-a82e-4fcb-ad82-aeed53f657ec None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:58.071901 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:58.103299 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 303/629] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:05:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:05:58.104356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bca0f-fb17-4498-9446-8b7d8577760e None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:58.162650 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df708cb-a82e-4fcb-ad82-aeed53f657ec None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:58.166397 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:58.202148 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d849c-ef70-43f1-a63b-27f39ad75090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:58.202787 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d849c-ef70-43f1-a63b-27f39ad75090 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:58.203062 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d849c-ef70-43f1-a63b-27f39ad75090 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:58.203332 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d849c-ef70-43f1-a63b-27f39ad75090 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:58.203989 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d849c-ef70-43f1-a63b-27f39ad75090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:58.204274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d849c-ef70-43f1-a63b-27f39ad75090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:58.205642 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d849c-ef70-43f1-a63b-27f39ad75090 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:58.208164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bca0f-fb17-4498-9446-8b7d8577760e None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:58.217333 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 327/630] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:58.218376 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d849c-ef70-43f1-a63b-27f39ad75090 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:58.248264 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d1154-9a0a-4867-a80b-1e21d66e6eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:58.248797 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d1154-9a0a-4867-a80b-1e21d66e6eac None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:58.249076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d1154-9a0a-4867-a80b-1e21d66e6eac None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:58.249349 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d1154-9a0a-4867-a80b-1e21d66e6eac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:58.250250 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d1154-9a0a-4867-a80b-1e21d66e6eac None admin] RBAC: Adding query filter params (role.id=008dc5c4798945a8bc61788f87211b2a, scope.project.id=1fd85e9620ea42a69363d006d715ad04, user.id=0274d60e5bf14a4a9d3477e0efe31988) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:58.250556 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d1154-9a0a-4867-a80b-1e21d66e6eac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:58.251997 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d1154-9a0a-4867-a80b-1e21d66e6eac None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:58.257767 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 304/631] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:05:58 2022] GET /identity/v3/role_assignments?user.id=0274d60e5bf14a4a9d3477e0efe31988&scope.project.id=1fd85e9620ea42a69363d006d715ad04&role.id=008dc5c4798945a8bc61788f87211b2a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:58.258561 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d1154-9a0a-4867-a80b-1e21d66e6eac None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:58.339191 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:58.371562 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d849c-ef70-43f1-a63b-27f39ad75090 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:58.373930 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d1154-9a0a-4867-a80b-1e21d66e6eac None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:58.404198 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:58.411868 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463251d0-2d25-46a6-9712-ae63584597f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:58.413121 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463251d0-2d25-46a6-9712-ae63584597f5 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:58.413458 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ac494-7bde-41f4-a654-fe0fe009273a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:58.414140 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463251d0-2d25-46a6-9712-ae63584597f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:58.414552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463251d0-2d25-46a6-9712-ae63584597f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:58.414742 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ac494-7bde-41f4-a654-fe0fe009273a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:58.415350 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ac494-7bde-41f4-a654-fe0fe009273a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:58.415835 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ac494-7bde-41f4-a654-fe0fe009273a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:58.424113 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ac494-7bde-41f4-a654-fe0fe009273a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:58.425798 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ac494-7bde-41f4-a654-fe0fe009273a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:58.429500 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463251d0-2d25-46a6-9712-ae63584597f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:58.431291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463251d0-2d25-46a6-9712-ae63584597f5 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:58.439078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-e93ac494-7bde-41f4-a654-fe0fe009273a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:58.439078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:58.439078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:58.439078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:58.439078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:58.439078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:58.439078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:58.439078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:58.439078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:58.439078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:58.439078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:58.439078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:58.439078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:05:58.439078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:05:58.439078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:05:58.440218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:05:58.440218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:58.440218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:58.440218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:58.440218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:58.440218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:58.440218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:58.440218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:58.440218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:58.440218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:58.440218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:58.440218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:58.440218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:58.440218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:58.440218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:58.440218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:58.440218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:58.441315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:05:58.441315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:05:58.441315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:05:58.441315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:05:58.441315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:05:58.441315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:05:58.441315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:58.441315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:05:58.443013 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 305/632] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:05:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:58.448608 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ac494-7bde-41f4-a654-fe0fe009273a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:58.456255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-463251d0-2d25-46a6-9712-ae63584597f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:58.456255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:58.456255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:58.456255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:58.456255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:58.456255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:58.456255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:58.456255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:58.456255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:58.456255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:58.456255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:58.456255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:58.456255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:05:58.456255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:05:58.456255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:05:58.456255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:05:58.457274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:58.457274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:58.457274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:58.457274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:58.457274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:58.457274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:58.457274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:58.457274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:58.457274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:58.457274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:58.457274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:58.457274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:58.457274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:58.457274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:58.457274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:58.457274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:58.457274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:05:58.459139 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:05:58.459139 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:05:58.459139 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:58.461585 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 328/633] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:58.468119 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463251d0-2d25-46a6-9712-ae63584597f5 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:58.572646 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ac494-7bde-41f4-a654-fe0fe009273a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:58.589366 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463251d0-2d25-46a6-9712-ae63584597f5 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:58.615213 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406d88a-cbab-4b1c-b3a4-6f0914ca77ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:58.616740 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:58.616978 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406d88a-cbab-4b1c-b3a4-6f0914ca77ad None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:58.617874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406d88a-cbab-4b1c-b3a4-6f0914ca77ad None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:58.618374 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406d88a-cbab-4b1c-b3a4-6f0914ca77ad None admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:58.619341 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406d88a-cbab-4b1c-b3a4-6f0914ca77ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:58.619740 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406d88a-cbab-4b1c-b3a4-6f0914ca77ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:58.622292 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406d88a-cbab-4b1c-b3a4-6f0914ca77ad None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:58.625267 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdd00e-b150-49fc-9ef4-61b76b8481da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:58.626006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdd00e-b150-49fc-9ef4-61b76b8481da None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:58.626276 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdd00e-b150-49fc-9ef4-61b76b8481da None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:58.626544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdd00e-b150-49fc-9ef4-61b76b8481da None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:58.627215 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bdd00e-b150-49fc-9ef4-61b76b8481da None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:58.627512 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bdd00e-b150-49fc-9ef4-61b76b8481da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:58.628871 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bdd00e-b150-49fc-9ef4-61b76b8481da None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:58.637726 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 306/634] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 15:05:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:58.641359 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 329/635] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:58.646646 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406d88a-cbab-4b1c-b3a4-6f0914ca77ad None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:58.647817 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdd00e-b150-49fc-9ef4-61b76b8481da None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:58.707178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:58.767228 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdd00e-b150-49fc-9ef4-61b76b8481da None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:58.781316 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406d88a-cbab-4b1c-b3a4-6f0914ca77ad None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:58.808291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f911a-c6a6-4458-9a7d-9bbf3af9f94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:58.809057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f911a-c6a6-4458-9a7d-9bbf3af9f94a None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:58.809470 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f911a-c6a6-4458-9a7d-9bbf3af9f94a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:58.809794 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f911a-c6a6-4458-9a7d-9bbf3af9f94a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:58.818200 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f911a-c6a6-4458-9a7d-9bbf3af9f94a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:58.820327 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f911a-c6a6-4458-9a7d-9bbf3af9f94a None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:58.824163 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6295d-6356-4111-a69f-876427b396cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:58.825005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6295d-6356-4111-a69f-876427b396cd None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:58.825476 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6295d-6356-4111-a69f-876427b396cd None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:58.826257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6295d-6356-4111-a69f-876427b396cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:58.827171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6295d-6356-4111-a69f-876427b396cd None admin] RBAC: Adding query filter params (role.id=008dc5c4798945a8bc61788f87211b2a, scope.project.id=1fd85e9620ea42a69363d006d715ad04, user.id=8098c9c25a384b33885bbe6bcaaf01a8) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:58.827705 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6295d-6356-4111-a69f-876427b396cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:58.829343 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6295d-6356-4111-a69f-876427b396cd None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:58.831706 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-6c4f911a-c6a6-4458-9a7d-9bbf3af9f94a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:58.831706 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:05:58.831706 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:05:58.831706 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:05:58.831706 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:05:58.831706 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:05:58.831706 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:05:58.831706 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:05:58.831706 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:05:58.831706 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:05:58.831706 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:05:58.831706 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:05:58.831706 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:05:58.831706 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:05:58.831706 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:05:58.832578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:05:58.832578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:05:58.832578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:05:58.832578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:05:58.832578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:05:58.832578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:05:58.832578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:05:58.832578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:05:58.832578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:05:58.832578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:05:58.832578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:05:58.832578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:05:58.832578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:05:58.832578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:05:58.832578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:05:58.832578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:05:58.832578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:05:58.833475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:05:58.833475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:05:58.833475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:05:58.833475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:05:58.833475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:05:58.833475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:05:58.833475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:05:58.833475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:05:58.833475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 330/636] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:05:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:05:58.838342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f911a-c6a6-4458-9a7d-9bbf3af9f94a None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:58.838710 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 307/637] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:05:58 2022] GET /identity/v3/role_assignments?user.id=8098c9c25a384b33885bbe6bcaaf01a8&scope.project.id=1fd85e9620ea42a69363d006d715ad04&role.id=008dc5c4798945a8bc61788f87211b2a => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:58.901597 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:58.958567 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f911a-c6a6-4458-9a7d-9bbf3af9f94a None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:58.995959 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3ba95-b638-48fa-a725-a410f6423084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:58.996873 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3ba95-b638-48fa-a725-a410f6423084 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:58.997294 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3ba95-b638-48fa-a725-a410f6423084 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:58.997831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3ba95-b638-48fa-a725-a410f6423084 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:58.998675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3ba95-b638-48fa-a725-a410f6423084 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:58.999122 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3ba95-b638-48fa-a725-a410f6423084 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:59.000742 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3ba95-b638-48fa-a725-a410f6423084 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:59.015190 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 331/638] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 15:05:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:05:59.024078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6295d-6356-4111-a69f-876427b396cd None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:05:59.141520 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6295d-6356-4111-a69f-876427b396cd None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:05:59.152799 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:05:59.179683 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b699ad-2ce4-498b-ae4c-178160840364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:05:59.180306 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b699ad-2ce4-498b-ae4c-178160840364 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:59.180583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b699ad-2ce4-498b-ae4c-178160840364 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:59.180857 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b699ad-2ce4-498b-ae4c-178160840364 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:59.181581 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b699ad-2ce4-498b-ae4c-178160840364 None admin] RBAC: Adding query filter params (role.id=008dc5c4798945a8bc61788f87211b2a, scope.project.id=1fd85e9620ea42a69363d006d715ad04, user.id=2f4a48b97bf9405eb44f593c41fe1e4d) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:05:59.181918 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b699ad-2ce4-498b-ae4c-178160840364 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:05:59.183448 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b699ad-2ce4-498b-ae4c-178160840364 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:05:59.189958 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 308/639] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:05:59 2022] GET /identity/v3/role_assignments?user.id=2f4a48b97bf9405eb44f593c41fe1e4d&scope.project.id=1fd85e9620ea42a69363d006d715ad04&role.id=008dc5c4798945a8bc61788f87211b2a => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:05:59.524254 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c89c9-5f4e-4a53-ab06-c4f3b8f5f5aa None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:59.524437 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c89c9-5f4e-4a53-ab06-c4f3b8f5f5aa None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:59.524723 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c89c9-5f4e-4a53-ab06-c4f3b8f5f5aa None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:59.526416 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 332/640] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:05:59.531703 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5a1f5-e781-4247-9dc8-8340469db955 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:05:59.531991 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5a1f5-e781-4247-9dc8-8340469db955 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:05:59.532262 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5a1f5-e781-4247-9dc8-8340469db955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:05:59.550799 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-46a5a1f5-e781-4247-9dc8-8340469db955 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:05:59.551980 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-46a5a1f5-e781-4247-9dc8-8340469db955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:05:59.619115 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 309/641] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:05:59.982429 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c89c9-5f4e-4a53-ab06-c4f3b8f5f5aa None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:00.119010 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c89c9-5f4e-4a53-ab06-c4f3b8f5f5aa None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:00.128502 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:00.176058 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f99885-4bed-4911-b764-cf8c2083883b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:00.176690 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f99885-4bed-4911-b764-cf8c2083883b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:00.176959 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f99885-4bed-4911-b764-cf8c2083883b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:00.177614 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f99885-4bed-4911-b764-cf8c2083883b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:00.200535 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f99885-4bed-4911-b764-cf8c2083883b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:06:00.206305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-d3f99885-4bed-4911-b764-cf8c2083883b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:06:00.206305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:00.206305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:00.206305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:00.206305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:00.206305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:00.206305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:00.206305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:00.206305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:00.206305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:00.206305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:00.206305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:00.206305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:06:00.206305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:06:00.206305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:06:00.206305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:06:00.207321 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:06:00.207321 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:06:00.207321 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:06:00.207321 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:06:00.207321 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:00.207321 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:00.207321 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:00.207321 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:00.207321 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:00.207321 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:00.207321 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:00.207321 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:00.207321 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:00.207321 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:00.207321 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:00.207321 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:00.208266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:00.208266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:00.208266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:00.208266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:00.208266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:06:00.208266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:06:00.208266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:06:00.208266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:06:00.208266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:06:00.208266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:06:00.208266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:06:00.208266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:00.215421 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5a1f5-e781-4247-9dc8-8340469db955 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:00.224901 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 333/642] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 15:05:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:00.390709 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5a1f5-e781-4247-9dc8-8340469db955 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:00.394142 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:00.434996 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11065d87-b628-4f70-83b6-dec2c5c0170d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:00.435701 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11065d87-b628-4f70-83b6-dec2c5c0170d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:00.435975 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11065d87-b628-4f70-83b6-dec2c5c0170d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:00.436240 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11065d87-b628-4f70-83b6-dec2c5c0170d None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:00.436914 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11065d87-b628-4f70-83b6-dec2c5c0170d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:00.437211 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11065d87-b628-4f70-83b6-dec2c5c0170d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:00.438789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11065d87-b628-4f70-83b6-dec2c5c0170d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:00.448541 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 310/643] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:06:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:00.454133 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f99885-4bed-4911-b764-cf8c2083883b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:00.560054 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f99885-4bed-4911-b764-cf8c2083883b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:00.594186 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ba713-dddc-4eee-816e-7874a72a21ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:00.594809 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ba713-dddc-4eee-816e-7874a72a21ed None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:00.595079 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ba713-dddc-4eee-816e-7874a72a21ed None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:00.595342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ba713-dddc-4eee-816e-7874a72a21ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:00.605671 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ba713-dddc-4eee-816e-7874a72a21ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:00.607515 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ba713-dddc-4eee-816e-7874a72a21ed None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:00.622019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-b85ba713-dddc-4eee-816e-7874a72a21ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:06:00.622019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:00.622019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:00.622019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:00.622019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:00.622019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:00.622019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:00.622019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:00.622019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:00.622019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:00.622019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:00.622019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:00.622019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:06:00.622019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:06:00.622019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:06:00.622019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:06:00.623005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:00.623005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:00.623005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:00.623005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:00.623005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:00.623005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:00.623005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:00.623005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:00.623005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:00.623005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:00.623005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:00.623005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:00.623005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:00.623005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:00.623005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:00.623005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:00.623005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:06:00.623907 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:06:00.623907 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:06:00.623907 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:00.623907 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 334/644] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:00.629137 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11065d87-b628-4f70-83b6-dec2c5c0170d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:00.739396 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11065d87-b628-4f70-83b6-dec2c5c0170d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:00.775390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc012c-796b-41da-b86c-6eecdbe94dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:00.776010 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc012c-796b-41da-b86c-6eecdbe94dae None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:00.776282 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc012c-796b-41da-b86c-6eecdbe94dae None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:00.776546 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc012c-796b-41da-b86c-6eecdbe94dae None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:00.777183 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc012c-796b-41da-b86c-6eecdbe94dae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:00.777480 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc012c-796b-41da-b86c-6eecdbe94dae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:00.778944 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc012c-796b-41da-b86c-6eecdbe94dae None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:00.792084 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 311/645] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:00.797669 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ba713-dddc-4eee-816e-7874a72a21ed None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:00.821771 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:00.907352 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ba713-dddc-4eee-816e-7874a72a21ed None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:00.924296 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db9a9e-5ba8-49d8-83d7-195255024dab None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:00.924602 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db9a9e-5ba8-49d8-83d7-195255024dab None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:00.924848 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db9a9e-5ba8-49d8-83d7-195255024dab None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:00.926466 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 312/646] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:06:00.931605 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c518c7-487f-47eb-a2d5-9d7d53765e74 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:00.932116 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c518c7-487f-47eb-a2d5-9d7d53765e74 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:00.932619 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c518c7-487f-47eb-a2d5-9d7d53765e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:00.948150 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0535c4-a627-4269-ba5e-640d20e43c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:00.948791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0535c4-a627-4269-ba5e-640d20e43c93 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:00.949065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0535c4-a627-4269-ba5e-640d20e43c93 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:00.949335 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0535c4-a627-4269-ba5e-640d20e43c93 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:00.952812 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-66c518c7-487f-47eb-a2d5-9d7d53765e74 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:00.954245 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-66c518c7-487f-47eb-a2d5-9d7d53765e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:00.958420 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0535c4-a627-4269-ba5e-640d20e43c93 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:00.959933 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0535c4-a627-4269-ba5e-640d20e43c93 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:00.977579 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-cd0535c4-a627-4269-ba5e-640d20e43c93 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:06:00.977579 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:00.977579 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:00.977579 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:00.977579 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:00.977579 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:00.977579 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:00.977579 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:00.977579 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:00.977579 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:00.977579 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:00.977579 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:00.977579 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:06:00.977579 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:06:00.977579 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:06:00.977579 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:06:00.978616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:00.978616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:00.978616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:06:00.978616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:06:00.978616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:06:00.978616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:06:00.978616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:00.978616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:00.978616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:00.978616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:00.978616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:00.978616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:00.978616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:00.978616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:00.978616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:00.978616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:00.978616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:00.978616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:00.979555 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:00.979555 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:00.979555 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:06:00.979555 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:06:00.979555 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:06:00.979555 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:06:00.979555 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:06:00.979555 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:06:00.979555 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:06:00.979555 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:00.979555 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 335/647] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Sep 23 15:06:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:00.985330 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:00.986628 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0535c4-a627-4269-ba5e-640d20e43c93 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:01.041841 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 313/648] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:06:01.080429 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:01.100680 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0535c4-a627-4269-ba5e-640d20e43c93 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:01.134202 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78ef21-082d-4783-bc8b-df61a86e0eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:01.134808 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78ef21-082d-4783-bc8b-df61a86e0eda None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:01.135083 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78ef21-082d-4783-bc8b-df61a86e0eda None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:01.135351 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78ef21-082d-4783-bc8b-df61a86e0eda None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:01.136067 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78ef21-082d-4783-bc8b-df61a86e0eda None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:01.136366 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78ef21-082d-4783-bc8b-df61a86e0eda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:01.137808 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78ef21-082d-4783-bc8b-df61a86e0eda None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:01.155636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 336/649] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Sep 23 15:06:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:01.161181 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c518c7-487f-47eb-a2d5-9d7d53765e74 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:01.265048 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c518c7-487f-47eb-a2d5-9d7d53765e74 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:01.299496 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef1909-7750-457a-99b7-0beed9567cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:01.300110 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef1909-7750-457a-99b7-0beed9567cd4 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:01.300384 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef1909-7750-457a-99b7-0beed9567cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:01.300651 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef1909-7750-457a-99b7-0beed9567cd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:01.325383 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:01.369206 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef1909-7750-457a-99b7-0beed9567cd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:01.370703 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef1909-7750-457a-99b7-0beed9567cd4 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:01.385872 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78ef21-082d-4783-bc8b-df61a86e0eda None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:01.478120 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 314/650] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:06:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:06:01.479797 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128586d9-3d95-4c0f-86e2-8e7198d68d55 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:01.480081 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128586d9-3d95-4c0f-86e2-8e7198d68d55 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:01.480354 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128586d9-3d95-4c0f-86e2-8e7198d68d55 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:01.482151 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 315/651] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:01.486697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128586d9-3d95-4c0f-86e2-8e7198d68d55 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:01.498424 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78ef21-082d-4783-bc8b-df61a86e0eda None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:01.535470 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a306698-d0f3-47b5-bf92-204533467883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:01.536024 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a306698-d0f3-47b5-bf92-204533467883 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:01.536301 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a306698-d0f3-47b5-bf92-204533467883 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:01.536565 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a306698-d0f3-47b5-bf92-204533467883 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:01.537136 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a306698-d0f3-47b5-bf92-204533467883 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:01.538565 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a306698-d0f3-47b5-bf92-204533467883 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:01.548457 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:01.550289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-4a306698-d0f3-47b5-bf92-204533467883 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 15:06:01.550289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:01.550289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:06:01.550289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:06:01.550289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:06:01.550289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:06:01.550289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:06:01.550289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:01.550289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 15:06:01.550289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:01.550289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:06:01.550289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:01.550289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:01.550289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:01.550289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:01.550289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:01.550289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:01.557349 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:01.557349 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:01.557349 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:01.557349 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:01.557349 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:01.557349 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:01.557349 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:06:01.557349 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:06:01.557349 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:06:01.557349 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:06:01.557349 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:01.557349 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:01.557349 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:01.557349 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:01.557349 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:01.557349 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:01.558261 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:01.558261 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:01.558261 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:01.558261 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:01.558261 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:01.558261 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:01.558261 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:01.558261 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:01.558261 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:01.558261 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:01.558261 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:06:01.558261 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:01.558261 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 15:06:01.558261 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:01.558261 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 337/652] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Sep 23 15:06:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:06:01.559083 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bf646-80c9-4b97-8dd6-e840157c8a6b None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:01.559083 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bf646-80c9-4b97-8dd6-e840157c8a6b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:01.559083 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bf646-80c9-4b97-8dd6-e840157c8a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:01.562964 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:01.575226 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-768bf646-80c9-4b97-8dd6-e840157c8a6b None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:01.576399 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-768bf646-80c9-4b97-8dd6-e840157c8a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:01.604749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128586d9-3d95-4c0f-86e2-8e7198d68d55 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:01.641637 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b665a26-d254-4d1b-9728-1bc6ceefe9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:01.642726 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b665a26-d254-4d1b-9728-1bc6ceefe9fb None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:01.643113 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b665a26-d254-4d1b-9728-1bc6ceefe9fb None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:01.643532 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b665a26-d254-4d1b-9728-1bc6ceefe9fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:01.657718 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 338/653] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:06:01.657718 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bf646-80c9-4b97-8dd6-e840157c8a6b None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:01.663915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b665a26-d254-4d1b-9728-1bc6ceefe9fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:01.665652 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b665a26-d254-4d1b-9728-1bc6ceefe9fb None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:01.683575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-8b665a26-d254-4d1b-9728-1bc6ceefe9fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:06:01.683575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:01.683575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:01.683575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:01.683575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:01.683575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:01.683575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:01.683575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:01.683575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:01.683575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:01.683575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:01.683575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:01.683575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:06:01.683575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:06:01.683575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:06:01.683575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:06:01.684625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:01.684625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:01.684625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:01.684625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:01.684625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:01.684625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:01.684625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:01.684625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:01.684625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:01.684625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:01.684625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:01.684625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:01.684625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:01.684625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:01.684625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:01.684625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:01.684625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:06:01.685748 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:06:01.685748 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:06:01.685748 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:01.685748 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 316/654] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:01.690724 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b665a26-d254-4d1b-9728-1bc6ceefe9fb None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:01.764551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bf646-80c9-4b97-8dd6-e840157c8a6b None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:01.794849 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:01.800975 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d670c-820f-465e-879d-6fd74621f11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:01.801586 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d670c-820f-465e-879d-6fd74621f11f None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:01.801896 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d670c-820f-465e-879d-6fd74621f11f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:01.802165 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d670c-820f-465e-879d-6fd74621f11f None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:01.802786 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d670c-820f-465e-879d-6fd74621f11f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:01.803075 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d670c-820f-465e-879d-6fd74621f11f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:01.804452 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d670c-820f-465e-879d-6fd74621f11f None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:01.805631 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b665a26-d254-4d1b-9728-1bc6ceefe9fb None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:01.809379 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 339/655] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Sep 23 15:06:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:01.814637 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab50ba-c740-46dc-ae28-a6a916459bbb None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:01.814914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab50ba-c740-46dc-ae28-a6a916459bbb None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:01.815182 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab50ba-c740-46dc-ae28-a6a916459bbb None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:01.816509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 340/656] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:01.817057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab50ba-c740-46dc-ae28-a6a916459bbb None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:01.823145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:01.848937 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa3821-8e2e-4575-b3f0-8f118a1f1998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:01.849559 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa3821-8e2e-4575-b3f0-8f118a1f1998 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:01.849843 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa3821-8e2e-4575-b3f0-8f118a1f1998 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:01.850110 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa3821-8e2e-4575-b3f0-8f118a1f1998 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:01.850739 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa3821-8e2e-4575-b3f0-8f118a1f1998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:01.851035 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa3821-8e2e-4575-b3f0-8f118a1f1998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:01.852456 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa3821-8e2e-4575-b3f0-8f118a1f1998 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:01.864548 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 317/657] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:01.870343 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e844d-fd25-40d7-aecf-981a8a37ee07 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:01.870647 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e844d-fd25-40d7-aecf-981a8a37ee07 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:01.870891 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e844d-fd25-40d7-aecf-981a8a37ee07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:01.888750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-880e844d-fd25-40d7-aecf-981a8a37ee07 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:01.890206 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-880e844d-fd25-40d7-aecf-981a8a37ee07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:01.926185 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab50ba-c740-46dc-ae28-a6a916459bbb None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:01.961262 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d4fd3-8beb-45b6-844c-27394b93f9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:01.962133 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d4fd3-8beb-45b6-844c-27394b93f9e1 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:01.962413 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d4fd3-8beb-45b6-844c-27394b93f9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:01.962680 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d4fd3-8beb-45b6-844c-27394b93f9e1 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:01.963298 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d4fd3-8beb-45b6-844c-27394b93f9e1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:01.963595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d4fd3-8beb-45b6-844c-27394b93f9e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:01.964950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d4fd3-8beb-45b6-844c-27394b93f9e1 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:01.967771 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 318/658] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:06:01.968432 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e844d-fd25-40d7-aecf-981a8a37ee07 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:01.986368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 341/659] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Sep 23 15:06:01 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:01.996234 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d4fd3-8beb-45b6-844c-27394b93f9e1 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:02.084333 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:02.089518 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:02.094180 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e844d-fd25-40d7-aecf-981a8a37ee07 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:02.139013 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f5619-a893-4cc1-bc01-2fbc4de3d17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:02.139673 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f5619-a893-4cc1-bc01-2fbc4de3d17b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:02.139817 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d4fd3-8beb-45b6-844c-27394b93f9e1 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:02.139975 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f5619-a893-4cc1-bc01-2fbc4de3d17b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:02.140217 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f5619-a893-4cc1-bc01-2fbc4de3d17b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:02.149733 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f5619-a893-4cc1-bc01-2fbc4de3d17b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:02.151605 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f5619-a893-4cc1-bc01-2fbc4de3d17b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:02.167738 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-db8f5619-a893-4cc1-bc01-2fbc4de3d17b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:06:02.167738 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:02.167738 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:02.167738 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:02.167738 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:02.167738 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:02.167738 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:02.167738 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:02.167738 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:02.167738 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:02.167738 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:02.167738 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:02.167738 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:06:02.167738 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:06:02.167738 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:06:02.168702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:06:02.168702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:02.168702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:02.168702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:02.168702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:02.168702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:02.168702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:02.168702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:02.168702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:02.168702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:02.168702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:02.168702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:02.168702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:02.168702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:02.168702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:02.168702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:02.168702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:02.169608 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:06:02.169608 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:06:02.169608 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:06:02.169608 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:06:02.169608 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:06:02.169608 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:06:02.169608 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:06:02.169608 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:02.169608 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 319/660] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:06:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:02.175058 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f5619-a893-4cc1-bc01-2fbc4de3d17b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:02.185112 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b12537-52b2-4d47-802b-adbe8fa5851b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:02.185858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b12537-52b2-4d47-802b-adbe8fa5851b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:02.186138 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b12537-52b2-4d47-802b-adbe8fa5851b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:02.186457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b12537-52b2-4d47-802b-adbe8fa5851b None admin] PATH_INFO: `/v3/services/network` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:02.187108 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b12537-52b2-4d47-802b-adbe8fa5851b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:02.189177 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b12537-52b2-4d47-802b-adbe8fa5851b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:02.201457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-36b12537-52b2-4d47-802b-adbe8fa5851b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 15:06:02.201457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:02.201457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:06:02.201457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:06:02.201457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:06:02.201457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:06:02.201457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:06:02.201457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:02.201457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 15:06:02.201457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:02.201457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:06:02.201457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:02.201457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:02.201457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:02.201457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:02.201457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:02.201457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:02.202551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:02.202551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:02.202551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:02.202551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:02.202551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:02.202551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:02.202551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:06:02.202551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:06:02.202551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:06:02.202551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:06:02.202551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:02.202551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:02.202551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:02.202551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:02.202551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:02.202551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:02.203393 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:02.203393 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:02.203393 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:02.203393 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:02.203393 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:02.203393 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:02.203393 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:02.203393 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:02.203393 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:02.203393 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:02.203393 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:06:02.203393 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:02.203393 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 15:06:02.203393 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:02.205773 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 342/661] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:06:01 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:06:02.210030 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b12537-52b2-4d47-802b-adbe8fa5851b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:02.295918 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f5619-a893-4cc1-bc01-2fbc4de3d17b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:02.324247 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b12537-52b2-4d47-802b-adbe8fa5851b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:02.330563 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ddc3a-47fc-4f9e-a436-10868ccdb0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:02.331176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ddc3a-47fc-4f9e-a436-10868ccdb0ba None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:02.331456 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ddc3a-47fc-4f9e-a436-10868ccdb0ba None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:02.331731 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ddc3a-47fc-4f9e-a436-10868ccdb0ba None admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:02.332416 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ddc3a-47fc-4f9e-a436-10868ccdb0ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:02.332714 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ddc3a-47fc-4f9e-a436-10868ccdb0ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:02.334178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ddc3a-47fc-4f9e-a436-10868ccdb0ba None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:02.351649 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 320/662] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 15:06:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:02.351649 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ddc3a-47fc-4f9e-a436-10868ccdb0ba None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:02.353566 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:02.366564 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49deb2-2568-46d0-a2ad-80aa2854060c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:02.367451 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:02.368035 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49deb2-2568-46d0-a2ad-80aa2854060c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:02.368234 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49deb2-2568-46d0-a2ad-80aa2854060c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:02.368563 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49deb2-2568-46d0-a2ad-80aa2854060c None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:02.369066 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49deb2-2568-46d0-a2ad-80aa2854060c None admin] RBAC: Adding query filter params (name=network) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:02.369374 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49deb2-2568-46d0-a2ad-80aa2854060c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:02.370766 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49deb2-2568-46d0-a2ad-80aa2854060c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:02.380309 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 343/663] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 15:06:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:02.381222 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49deb2-2568-46d0-a2ad-80aa2854060c None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:02.454990 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ddc3a-47fc-4f9e-a436-10868ccdb0ba None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:02.484815 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49deb2-2568-46d0-a2ad-80aa2854060c None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:02.490451 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cd2e6-69e9-4795-81d1-065b30d73ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:02.491090 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cd2e6-69e9-4795-81d1-065b30d73ff1 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:02.491368 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cd2e6-69e9-4795-81d1-065b30d73ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:02.491752 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cd2e6-69e9-4795-81d1-065b30d73ff1 None admin] PATH_INFO: `/v3/services/image` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:02.492371 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cd2e6-69e9-4795-81d1-065b30d73ff1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:02.493942 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cd2e6-69e9-4795-81d1-065b30d73ff1 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:02.505844 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-922cd2e6-69e9-4795-81d1-065b30d73ff1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 15:06:02.505844 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:02.505844 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:06:02.505844 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:06:02.505844 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:06:02.505844 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:06:02.505844 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:06:02.505844 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:02.505844 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 15:06:02.505844 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:02.505844 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:06:02.505844 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:02.505844 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:02.505844 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:02.505844 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:02.505844 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:02.505844 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:02.506923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:02.506923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:02.506923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:02.506923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:02.506923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:02.506923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:02.506923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:06:02.506923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:06:02.506923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:06:02.506923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:06:02.506923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:02.506923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:02.506923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:02.506923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:02.506923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:02.506923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:02.507929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:02.507929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:02.507929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:02.507929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:02.507929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:02.507929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:02.507929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:02.507929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:02.507929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:02.507929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:02.507929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:06:02.507929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:02.507929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 15:06:02.507929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:02.507929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 321/664] 10.222.0.48 () {56 vars in 1105 bytes} [Fri Sep 23 15:06:02 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:02.508768 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cd2e6-69e9-4795-81d1-065b30d73ff1 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:02.525973 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36733a-8a2e-4842-9a19-9a843228dbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:02.526583 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36733a-8a2e-4842-9a19-9a843228dbe8 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:02.526860 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36733a-8a2e-4842-9a19-9a843228dbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:02.527129 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36733a-8a2e-4842-9a19-9a843228dbe8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:02.527921 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36733a-8a2e-4842-9a19-9a843228dbe8 None admin] RBAC: Adding query filter params (role.id=07d4069c848d4ee9abb586256ee26f20, scope.project.id=1fd85e9620ea42a69363d006d715ad04, user.id=542c7a84dd044588a42a9e3414cab516) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:02.528180 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36733a-8a2e-4842-9a19-9a843228dbe8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:02.529601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36733a-8a2e-4842-9a19-9a843228dbe8 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:02.534993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 344/665] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:06:02 2022] GET /identity/v3/role_assignments?user.id=542c7a84dd044588a42a9e3414cab516&scope.project.id=1fd85e9620ea42a69363d006d715ad04&role.id=07d4069c848d4ee9abb586256ee26f20 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:02.535864 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36733a-8a2e-4842-9a19-9a843228dbe8 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:02.616752 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:02.621465 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:02.639270 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cd2e6-69e9-4795-81d1-065b30d73ff1 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:02.677178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708cfb9-0c0c-44e9-ab36-8e1d8d382451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:02.678124 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708cfb9-0c0c-44e9-ab36-8e1d8d382451 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:02.678547 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708cfb9-0c0c-44e9-ab36-8e1d8d382451 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:02.679030 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708cfb9-0c0c-44e9-ab36-8e1d8d382451 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:02.679868 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708cfb9-0c0c-44e9-ab36-8e1d8d382451 None admin] RBAC: Adding query filter params (type=network) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:02.680374 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708cfb9-0c0c-44e9-ab36-8e1d8d382451 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:02.681983 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708cfb9-0c0c-44e9-ab36-8e1d8d382451 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:02.693722 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36733a-8a2e-4842-9a19-9a843228dbe8 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:02.694522 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 322/666] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 15:06:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:02.732902 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d9947-acf4-45aa-99dd-0cd32dcc33ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:02.733717 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d9947-acf4-45aa-99dd-0cd32dcc33ac None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:02.734067 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d9947-acf4-45aa-99dd-0cd32dcc33ac None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:02.734442 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d9947-acf4-45aa-99dd-0cd32dcc33ac None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:02.735176 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d9947-acf4-45aa-99dd-0cd32dcc33ac None admin] RBAC: Adding query filter params (name=image) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:02.735544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d9947-acf4-45aa-99dd-0cd32dcc33ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:02.737072 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d9947-acf4-45aa-99dd-0cd32dcc33ac None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:02.743101 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 345/667] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:06:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:02.749148 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708cfb9-0c0c-44e9-ab36-8e1d8d382451 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:02.873977 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708cfb9-0c0c-44e9-ab36-8e1d8d382451 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:02.912167 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0781b2-9e2d-4715-b1c9-2a5e32985e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:02.912167 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0781b2-9e2d-4715-b1c9-2a5e32985e27 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:02.912167 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0781b2-9e2d-4715-b1c9-2a5e32985e27 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:02.912167 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0781b2-9e2d-4715-b1c9-2a5e32985e27 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:02.912645 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0781b2-9e2d-4715-b1c9-2a5e32985e27 None admin] RBAC: Adding query filter params (type=image) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:02.912896 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0781b2-9e2d-4715-b1c9-2a5e32985e27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:02.914342 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0781b2-9e2d-4715-b1c9-2a5e32985e27 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:02.919644 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 323/668] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:06:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:04.412445 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad198792-00e6-4922-9d3d-deb32b1d9840 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:04.413000 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad198792-00e6-4922-9d3d-deb32b1d9840 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:04.413000 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad198792-00e6-4922-9d3d-deb32b1d9840 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:04.414625 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 346/669] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:04.419982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31a0bd-ffce-45e3-a19e-cbb9a37a2064 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:04.420386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31a0bd-ffce-45e3-a19e-cbb9a37a2064 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:04.420572 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31a0bd-ffce-45e3-a19e-cbb9a37a2064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:04.438811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-2e31a0bd-ffce-45e3-a19e-cbb9a37a2064 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:04.439992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-2e31a0bd-ffce-45e3-a19e-cbb9a37a2064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:04.442884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:04.510434 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 324/670] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:06:04.825582 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad198792-00e6-4922-9d3d-deb32b1d9840 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:05.010742 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad198792-00e6-4922-9d3d-deb32b1d9840 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:05.028743 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:05.073953 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ee15d-c69d-42ac-ad69-54a7b35ba31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:05.074761 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad2785-08ac-435c-989d-dfa3dbb79086 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:05.075047 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad2785-08ac-435c-989d-dfa3dbb79086 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:05.075324 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad2785-08ac-435c-989d-dfa3dbb79086 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:05.075597 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ee15d-c69d-42ac-ad69-54a7b35ba31f None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:05.077087 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 325/671] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:06:05.082250 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ee15d-c69d-42ac-ad69-54a7b35ba31f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:05.082500 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2fc1a-e1aa-4959-89e6-a28369a2514d None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:05.085314 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2fc1a-e1aa-4959-89e6-a28369a2514d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:05.085314 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2fc1a-e1aa-4959-89e6-a28369a2514d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:05.086055 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ee15d-c69d-42ac-ad69-54a7b35ba31f None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:05.088636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ee15d-c69d-42ac-ad69-54a7b35ba31f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:05.090658 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ee15d-c69d-42ac-ad69-54a7b35ba31f None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:05.104035 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-c8a2fc1a-e1aa-4959-89e6-a28369a2514d None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:05.105014 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-c8a2fc1a-e1aa-4959-89e6-a28369a2514d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:05.115213 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 347/672] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 15:06:04 2022] POST /identity/v3/services => generated 251 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:06:05.162282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9564d60-96b6-48d4-99cd-7445f0a346c0 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:05.162937 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9564d60-96b6-48d4-99cd-7445f0a346c0 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:05.163408 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9564d60-96b6-48d4-99cd-7445f0a346c0 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:05.165328 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 348/673] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:06:05.170959 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2e09e-a4c5-4701-83dd-3398dcc4a23c None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:05.171240 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2e09e-a4c5-4701-83dd-3398dcc4a23c None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:05.171514 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2e09e-a4c5-4701-83dd-3398dcc4a23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:05.193336 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-b5a2e09e-a4c5-4701-83dd-3398dcc4a23c None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:05.194633 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-b5a2e09e-a4c5-4701-83dd-3398dcc4a23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:05.211889 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 326/674] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:05 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:06:05.281940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 349/675] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:05 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:06:05.369500 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b9cd1-e043-49fc-be90-61e4dc1de1a4 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:05.370162 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b9cd1-e043-49fc-be90-61e4dc1de1a4 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:05.370413 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b9cd1-e043-49fc-be90-61e4dc1de1a4 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:05.372104 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 327/676] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:05.377799 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e4411-eb71-4112-a98d-4ed24f8e3937 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:05.378378 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e4411-eb71-4112-a98d-4ed24f8e3937 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:05.379022 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e4411-eb71-4112-a98d-4ed24f8e3937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:05.400235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-565e4411-eb71-4112-a98d-4ed24f8e3937 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:05.401777 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-565e4411-eb71-4112-a98d-4ed24f8e3937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:05.473166 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 350/677] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:05 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:06:05.560275 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b9cd1-e043-49fc-be90-61e4dc1de1a4 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:05.603603 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e4411-eb71-4112-a98d-4ed24f8e3937 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:05.633260 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:05.642616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:05.677968 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b9cd1-e043-49fc-be90-61e4dc1de1a4 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:05.729732 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e4411-eb71-4112-a98d-4ed24f8e3937 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:05.731549 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b5b9b-3925-4813-9fba-2e4834fff612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:05.733050 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b5b9b-3925-4813-9fba-2e4834fff612 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:05.733328 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b5b9b-3925-4813-9fba-2e4834fff612 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:05.733598 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b5b9b-3925-4813-9fba-2e4834fff612 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:05.747118 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b5b9b-3925-4813-9fba-2e4834fff612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:06:05.752879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-e15b5b9b-3925-4813-9fba-2e4834fff612 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:06:05.752879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:05.752879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:05.752879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:05.752879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:05.752879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:05.752879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:05.752879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:05.752879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:05.752879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:05.752879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:05.752879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:05.752879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:06:05.752879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:06:05.752879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:06:05.752879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:06:05.753992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:06:05.753992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:06:05.753992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:06:05.753992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:06:05.753992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:05.753992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:05.753992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:05.753992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:05.753992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:05.753992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:05.753992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:05.753992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:05.753992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:05.753992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:05.753992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:05.753992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:05.754838 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:05.754838 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:05.754838 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:05.754838 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:05.754838 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:06:05.754838 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:06:05.754838 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:06:05.754838 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:06:05.754838 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:06:05.754838 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:06:05.754838 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:06:05.754838 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:05.754838 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 328/678] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 15:06:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:05.760671 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b5b9b-3925-4813-9fba-2e4834fff612 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:05.770636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ec109-dcf9-4029-bd88-12df759e03ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:05.771439 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ec109-dcf9-4029-bd88-12df759e03ff None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:05.771881 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ec109-dcf9-4029-bd88-12df759e03ff None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:05.772303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ec109-dcf9-4029-bd88-12df759e03ff None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:05.773092 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ec109-dcf9-4029-bd88-12df759e03ff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:05.774720 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ec109-dcf9-4029-bd88-12df759e03ff None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:05.794497 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 351/679] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 15:06:05 2022] POST /identity/v3/services => generated 240 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:06:05.811642 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ec109-dcf9-4029-bd88-12df759e03ff None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:05.892627 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b5b9b-3925-4813-9fba-2e4834fff612 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:05.923167 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:05.930046 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:05.951064 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ec109-dcf9-4029-bd88-12df759e03ff None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:05.955550 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28c74f-9227-4779-88fe-4005e48d9f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:05.956328 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28c74f-9227-4779-88fe-4005e48d9f87 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:05.956701 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28c74f-9227-4779-88fe-4005e48d9f87 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:05.957068 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28c74f-9227-4779-88fe-4005e48d9f87 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:05.957925 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28c74f-9227-4779-88fe-4005e48d9f87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:05.958352 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28c74f-9227-4779-88fe-4005e48d9f87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:05.960004 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28c74f-9227-4779-88fe-4005e48d9f87 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:05.974034 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 329/680] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:06:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:05.980357 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28c74f-9227-4779-88fe-4005e48d9f87 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:06.008123 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189573fc-56a5-4c26-8285-64ed3937f5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:06.008767 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189573fc-56a5-4c26-8285-64ed3937f5d9 None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:06.009041 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189573fc-56a5-4c26-8285-64ed3937f5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:06.009312 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189573fc-56a5-4c26-8285-64ed3937f5d9 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:06.010581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189573fc-56a5-4c26-8285-64ed3937f5d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:06.011998 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189573fc-56a5-4c26-8285-64ed3937f5d9 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:06.037832 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 352/681] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 15:06:05 2022] POST /identity/v3/services => generated 242 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:06:06.104243 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28c74f-9227-4779-88fe-4005e48d9f87 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:06.148247 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df079078-1d0c-45ca-ad1e-c00235929c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:06.148996 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df079078-1d0c-45ca-ad1e-c00235929c12 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:06.149274 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df079078-1d0c-45ca-ad1e-c00235929c12 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:06.149542 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df079078-1d0c-45ca-ad1e-c00235929c12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:06.162265 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df079078-1d0c-45ca-ad1e-c00235929c12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:06.163881 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df079078-1d0c-45ca-ad1e-c00235929c12 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:06.179053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-df079078-1d0c-45ca-ad1e-c00235929c12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:06:06.179053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:06.179053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:06.179053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:06.179053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:06.179053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:06.179053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:06.179053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:06.179053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:06.179053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:06.179053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:06.179053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:06.179053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:06:06.179053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:06:06.179053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:06:06.179053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:06:06.180126 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:06.180126 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:06.180126 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:06.180126 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:06.180126 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:06.180126 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:06.180126 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:06.180126 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:06.180126 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:06.180126 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:06.180126 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:06.180126 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:06.180126 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:06.180126 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:06.180126 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:06.180126 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:06.180126 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:06:06.181056 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:06:06.181056 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:06:06.181056 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:06.181056 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 330/682] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:06.185963 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189573fc-56a5-4c26-8285-64ed3937f5d9 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:06.296848 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189573fc-56a5-4c26-8285-64ed3937f5d9 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:06.331510 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d0df3-ef0b-43bb-966b-b430e437491a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:06.332119 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d0df3-ef0b-43bb-966b-b430e437491a None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:06.332389 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d0df3-ef0b-43bb-966b-b430e437491a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:06.332654 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d0df3-ef0b-43bb-966b-b430e437491a None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:06.333284 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d0df3-ef0b-43bb-966b-b430e437491a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:06.333578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d0df3-ef0b-43bb-966b-b430e437491a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:06.334986 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d0df3-ef0b-43bb-966b-b430e437491a None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:06.349130 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 353/683] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:06.354494 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df079078-1d0c-45ca-ad1e-c00235929c12 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:06.388613 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:06.464905 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df079078-1d0c-45ca-ad1e-c00235929c12 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:06.499212 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d09c8c-4733-4efd-8283-bba33a4a1530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:06.500118 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d09c8c-4733-4efd-8283-bba33a4a1530 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:06.500533 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d09c8c-4733-4efd-8283-bba33a4a1530 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:06.500940 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d09c8c-4733-4efd-8283-bba33a4a1530 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:06.508939 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d09c8c-4733-4efd-8283-bba33a4a1530 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:06.510693 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d09c8c-4733-4efd-8283-bba33a4a1530 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:06.521801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-c2d09c8c-4733-4efd-8283-bba33a4a1530 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:06:06.521801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:06.521801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:06.521801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:06.521801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:06.521801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:06.521801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:06.521801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:06.521801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:06.521801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:06.521801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:06.521801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:06.521801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:06:06.521801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:06:06.521801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:06:06.521801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:06:06.522929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:06.522929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:06.522929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:06:06.522929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:06:06.522929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:06:06.522929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:06:06.522929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:06.522929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:06.522929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:06.522929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:06.522929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:06.522929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:06.522929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:06.522929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:06.522929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:06.522929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:06.522929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:06.522929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:06.524220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:06.524220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:06.524220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:06:06.524220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:06:06.524220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:06:06.524220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:06:06.524220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:06:06.524220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:06:06.524220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:06:06.524220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:06.526342 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 331/684] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Sep 23 15:06:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:06:06.532321 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d0df3-ef0b-43bb-966b-b430e437491a None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:06.547532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:06.637773 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d0df3-ef0b-43bb-966b-b430e437491a None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:06.676186 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baf538-3083-4f0d-a04e-4367feed46e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:06.676788 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baf538-3083-4f0d-a04e-4367feed46e3 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:06.677055 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baf538-3083-4f0d-a04e-4367feed46e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:06.677322 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baf538-3083-4f0d-a04e-4367feed46e3 None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:06.678070 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baf538-3083-4f0d-a04e-4367feed46e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:06.678368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baf538-3083-4f0d-a04e-4367feed46e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:06.679880 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baf538-3083-4f0d-a04e-4367feed46e3 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:06.697387 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 354/685] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Sep 23 15:06:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:06.702917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d09c8c-4733-4efd-8283-bba33a4a1530 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:06.804771 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:06.814145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d09c8c-4733-4efd-8283-bba33a4a1530 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:06.847771 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691567c6-54c2-4552-832a-b1f7125d7fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:06.848724 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691567c6-54c2-4552-832a-b1f7125d7fdc None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:06.849208 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691567c6-54c2-4552-832a-b1f7125d7fdc None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:06.849758 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691567c6-54c2-4552-832a-b1f7125d7fdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:06.860783 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691567c6-54c2-4552-832a-b1f7125d7fdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:06.862634 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691567c6-54c2-4552-832a-b1f7125d7fdc None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:06.877076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-691567c6-54c2-4552-832a-b1f7125d7fdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:06:06.877076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:06.877076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:06.877076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:06.877076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:06.877076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:06.877076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:06.877076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:06.877076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:06.877076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:06.877076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:06.877076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:06.877076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:06:06.877076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:06:06.877076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:06:06.877076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:06:06.878106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:06.878106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:06.878106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:06.878106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:06.878106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:06.878106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:06.878106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:06.878106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:06.878106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:06.878106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:06.878106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:06.878106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:06.878106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:06.878106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:06.878106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:06.878106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:06.878106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:06:06.879032 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:06:06.879032 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:06:06.879032 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:06.881047 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 332/686] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:06.886865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baf538-3083-4f0d-a04e-4367feed46e3 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:06.958198 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:06.989286 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baf538-3083-4f0d-a04e-4367feed46e3 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:07.024025 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7f654-afa8-458e-b5ad-c776bab4153a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:07.024654 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7f654-afa8-458e-b5ad-c776bab4153a None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:07.024960 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7f654-afa8-458e-b5ad-c776bab4153a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:07.025263 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7f654-afa8-458e-b5ad-c776bab4153a None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:07.026089 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7f654-afa8-458e-b5ad-c776bab4153a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:07.026411 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7f654-afa8-458e-b5ad-c776bab4153a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:07.027961 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7f654-afa8-458e-b5ad-c776bab4153a None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:07.040618 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 355/687] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:07.046112 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691567c6-54c2-4552-832a-b1f7125d7fdc None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:07.150681 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691567c6-54c2-4552-832a-b1f7125d7fdc None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:07.184628 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b999f-5e2b-4d11-832c-4e30aefba05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:07.185256 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b999f-5e2b-4d11-832c-4e30aefba05b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:07.185526 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b999f-5e2b-4d11-832c-4e30aefba05b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:07.185943 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b999f-5e2b-4d11-832c-4e30aefba05b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:07.192617 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b999f-5e2b-4d11-832c-4e30aefba05b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:07.194145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b999f-5e2b-4d11-832c-4e30aefba05b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:07.205638 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-984b999f-5e2b-4d11-832c-4e30aefba05b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:06:07.205638 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:07.205638 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:07.205638 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:07.205638 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:07.205638 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:07.205638 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:07.205638 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:07.205638 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:07.205638 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:07.205638 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:07.205638 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:07.205638 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:06:07.205638 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:06:07.205638 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:06:07.206567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:06:07.206567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:07.206567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:07.206567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:07.206567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:07.206567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:07.206567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:07.206567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:07.206567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:07.206567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:07.206567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:07.206567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:07.206567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:07.206567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:07.206567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:07.206567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:07.206567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:07.207497 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:06:07.207497 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:06:07.207497 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:06:07.207497 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:06:07.207497 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:06:07.207497 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:06:07.207497 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:06:07.207497 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:07.207497 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 333/688] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:06:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:07.212698 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7f654-afa8-458e-b5ad-c776bab4153a None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:07.324481 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7f654-afa8-458e-b5ad-c776bab4153a None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:07.354078 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:07.359548 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d02b64-c2a3-4fca-bb93-f5949243edf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:07.360618 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d02b64-c2a3-4fca-bb93-f5949243edf5 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:07.361255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d02b64-c2a3-4fca-bb93-f5949243edf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:07.361806 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d02b64-c2a3-4fca-bb93-f5949243edf5 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:07.362544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d02b64-c2a3-4fca-bb93-f5949243edf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:07.363182 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d02b64-c2a3-4fca-bb93-f5949243edf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:07.365015 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d02b64-c2a3-4fca-bb93-f5949243edf5 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:07.379011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 356/689] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 15:06:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:07.386780 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b999f-5e2b-4d11-832c-4e30aefba05b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:07.393220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:07.507722 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b999f-5e2b-4d11-832c-4e30aefba05b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:07.540927 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067dae79-9649-429f-942e-fde767c05e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:07.541587 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dae79-9649-429f-942e-fde767c05e6a None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:07.541887 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dae79-9649-429f-942e-fde767c05e6a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:07.542156 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dae79-9649-429f-942e-fde767c05e6a None admin] PATH_INFO: `/v3/projects/1fd85e9620ea42a69363d006d715ad04/users/542c7a84dd044588a42a9e3414cab516/roles/07d4069c848d4ee9abb586256ee26f20` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:07.544027 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067dae79-9649-429f-942e-fde767c05e6a None admin] RBAC: Authorizing `identity:create_grant(project_id=1fd85e9620ea42a69363d006d715ad04, user_id=542c7a84dd044588a42a9e3414cab516, role_id=07d4069c848d4ee9abb586256ee26f20)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:07.545452 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067dae79-9649-429f-942e-fde767c05e6a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:07.561005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 334/690] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 15:06:07 2022] PUT /identity/v3/projects/1fd85e9620ea42a69363d006d715ad04/users/542c7a84dd044588a42a9e3414cab516/roles/07d4069c848d4ee9abb586256ee26f20 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:06:07.722170 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf2873-1c93-4b51-b4fc-a6c17dd2841f None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:07.722565 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf2873-1c93-4b51-b4fc-a6c17dd2841f None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:07.722734 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf2873-1c93-4b51-b4fc-a6c17dd2841f None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:07.729613 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 357/691] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:07.733160 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749a709-d58d-4d3b-9645-0ba114962f77 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:07.733776 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749a709-d58d-4d3b-9645-0ba114962f77 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:07.737832 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749a709-d58d-4d3b-9645-0ba114962f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:07.756285 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-b749a709-d58d-4d3b-9645-0ba114962f77 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:07.757973 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-b749a709-d58d-4d3b-9645-0ba114962f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:07.820869 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:07.831278 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 335/692] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:07 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:06:08.147060 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf2873-1c93-4b51-b4fc-a6c17dd2841f None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:08.254739 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf2873-1c93-4b51-b4fc-a6c17dd2841f None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:08.291646 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed91c57-36e6-4e20-a99c-676cdbee6175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:08.292684 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed91c57-36e6-4e20-a99c-676cdbee6175 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:08.293152 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed91c57-36e6-4e20-a99c-676cdbee6175 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:08.293652 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed91c57-36e6-4e20-a99c-676cdbee6175 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:08.294435 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed91c57-36e6-4e20-a99c-676cdbee6175 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:08.296000 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed91c57-36e6-4e20-a99c-676cdbee6175 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:08.300055 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2e025-d230-4a88-81be-7e00f97a4ab2 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:08.300275 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2e025-d230-4a88-81be-7e00f97a4ab2 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:08.300511 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2e025-d230-4a88-81be-7e00f97a4ab2 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:08.303147 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 336/693] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:08.306478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-2ed91c57-36e6-4e20-a99c-676cdbee6175 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 15:06:08.306478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:08.306478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:06:08.306478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:06:08.306478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:06:08.306478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:06:08.306478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:06:08.306478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:08.306478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 15:06:08.306478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:08.306478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:06:08.306478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:08.306478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:08.306478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:08.306478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:08.306478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:08.306478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:08.307472 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:08.307472 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:08.307472 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:08.307472 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:08.307472 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:08.307472 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:08.307472 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:06:08.307472 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:06:08.307472 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:06:08.307472 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:06:08.307472 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:08.307472 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:08.307472 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:08.307472 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:08.307472 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:08.307472 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:08.308313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:08.308313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:08.308313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:08.308313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:08.308313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:08.308313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:08.308313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:08.308313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:08.308313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:08.308313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:08.308313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:06:08.308313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:08.308313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 15:06:08.308313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:08.309060 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea536143-e60d-4377-b188-0d2f408679be None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:08.309060 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea536143-e60d-4377-b188-0d2f408679be None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:08.309060 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea536143-e60d-4377-b188-0d2f408679be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:08.311496 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 358/694] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Sep 23 15:06:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:08.318198 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed91c57-36e6-4e20-a99c-676cdbee6175 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:08.333296 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-ea536143-e60d-4377-b188-0d2f408679be None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:08.334621 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-ea536143-e60d-4377-b188-0d2f408679be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:08.415689 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 337/695] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:08 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:06:08.501574 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:08.544853 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed91c57-36e6-4e20-a99c-676cdbee6175 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:08.577535 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25511794-f0c0-4f4e-95a7-520035b1ab03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:08.578171 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25511794-f0c0-4f4e-95a7-520035b1ab03 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:08.578497 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25511794-f0c0-4f4e-95a7-520035b1ab03 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:08.578768 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25511794-f0c0-4f4e-95a7-520035b1ab03 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:08.579387 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25511794-f0c0-4f4e-95a7-520035b1ab03 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:08.579709 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25511794-f0c0-4f4e-95a7-520035b1ab03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:08.581032 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25511794-f0c0-4f4e-95a7-520035b1ab03 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:08.585802 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 359/696] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Sep 23 15:06:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:08.591495 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea536143-e60d-4377-b188-0d2f408679be None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:08.667784 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab9e73-211b-4f49-b267-87851a30df39 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:08.668408 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab9e73-211b-4f49-b267-87851a30df39 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:08.668889 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab9e73-211b-4f49-b267-87851a30df39 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:08.670727 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 360/697] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:06:08.675732 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be76ca-37ca-4cbd-8781-b2025eeec496 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:08.676245 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be76ca-37ca-4cbd-8781-b2025eeec496 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:08.676714 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be76ca-37ca-4cbd-8781-b2025eeec496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:08.695022 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-e0be76ca-37ca-4cbd-8781-b2025eeec496 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:08.695820 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea536143-e60d-4377-b188-0d2f408679be None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:08.696765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-e0be76ca-37ca-4cbd-8781-b2025eeec496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:08.728362 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:08.742008 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf243ead-0a1a-4de6-8ba3-10e4dd6929f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:08.742675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf243ead-0a1a-4de6-8ba3-10e4dd6929f3 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:08.742929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf243ead-0a1a-4de6-8ba3-10e4dd6929f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:08.743200 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf243ead-0a1a-4de6-8ba3-10e4dd6929f3 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:08.743851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf243ead-0a1a-4de6-8ba3-10e4dd6929f3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:08.744192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf243ead-0a1a-4de6-8ba3-10e4dd6929f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:08.745568 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf243ead-0a1a-4de6-8ba3-10e4dd6929f3 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:08.753880 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 338/698] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Sep 23 15:06:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:08.753880 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf243ead-0a1a-4de6-8ba3-10e4dd6929f3 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:08.785134 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 361/699] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:08 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:06:08.785134 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be76ca-37ca-4cbd-8781-b2025eeec496 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:08.828136 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:08.875531 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf243ead-0a1a-4de6-8ba3-10e4dd6929f3 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:08.894437 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be76ca-37ca-4cbd-8781-b2025eeec496 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:08.911421 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d52fd5-2404-4211-9ea2-773e38126b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:08.912255 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d52fd5-2404-4211-9ea2-773e38126b28 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:08.912630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d52fd5-2404-4211-9ea2-773e38126b28 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:08.912998 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d52fd5-2404-4211-9ea2-773e38126b28 None admin] PATH_INFO: `/v3/services/network` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:08.913710 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d52fd5-2404-4211-9ea2-773e38126b28 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:08.915221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d52fd5-2404-4211-9ea2-773e38126b28 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:08.924692 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-d4d52fd5-2404-4211-9ea2-773e38126b28 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 15:06:08.924692 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:08.924692 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:06:08.924692 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:06:08.924692 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:06:08.924692 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:06:08.924692 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:06:08.924692 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:08.924692 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 15:06:08.924692 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:08.924692 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:06:08.924692 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:08.924692 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:08.924692 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:08.924692 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:08.924692 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:08.924692 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:08.925923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:08.925923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:08.925923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:08.925923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:08.925923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:08.925923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:08.925923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:06:08.925923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:06:08.925923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:06:08.925923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:06:08.925923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:08.925923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:08.925923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:08.925923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:08.925923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:08.925923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:08.927000 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:08.927000 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:08.927000 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:08.927000 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:08.927000 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:08.927000 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:08.927000 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:08.927000 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:08.927000 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:08.927000 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:08.927000 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:06:08.927000 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:08.927000 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 15:06:08.927000 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:08.933272 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 339/700] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:06:08 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:08.934849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d52fd5-2404-4211-9ea2-773e38126b28 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:08.943583 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4a5bc-39ca-4069-baff-6e22f9a1dc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:08.944252 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4a5bc-39ca-4069-baff-6e22f9a1dc68 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:08.944529 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4a5bc-39ca-4069-baff-6e22f9a1dc68 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:08.944798 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4a5bc-39ca-4069-baff-6e22f9a1dc68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:08.945637 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4a5bc-39ca-4069-baff-6e22f9a1dc68 None admin] RBAC: Adding query filter params (interface=public, service_id=7ddfda6325ad4015b1778a635ea144e4, region_id=RegionOne) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:08.946049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4a5bc-39ca-4069-baff-6e22f9a1dc68 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:08.947478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4a5bc-39ca-4069-baff-6e22f9a1dc68 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:08.955485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 362/701] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Sep 23 15:06:08 2022] GET /identity/v3/endpoints?service_id=7ddfda6325ad4015b1778a635ea144e4&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:08.961284 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4a5bc-39ca-4069-baff-6e22f9a1dc68 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:08.994386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:09.048788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d52fd5-2404-4211-9ea2-773e38126b28 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:09.062748 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4a5bc-39ca-4069-baff-6e22f9a1dc68 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:09.076405 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:09.088786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e44b1-2126-4028-9d37-47d098a28a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:09.089853 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e44b1-2126-4028-9d37-47d098a28a0b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:09.090411 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e44b1-2126-4028-9d37-47d098a28a0b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:09.090872 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e44b1-2126-4028-9d37-47d098a28a0b None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:09.091684 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e44b1-2126-4028-9d37-47d098a28a0b None admin] RBAC: Adding query filter params (name=network) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:09.092173 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e44b1-2126-4028-9d37-47d098a28a0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:09.093937 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e44b1-2126-4028-9d37-47d098a28a0b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:09.098254 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f7ed5-0760-476f-9c17-ad07134f3924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:09.098873 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f7ed5-0760-476f-9c17-ad07134f3924 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:09.099150 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f7ed5-0760-476f-9c17-ad07134f3924 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:09.099418 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f7ed5-0760-476f-9c17-ad07134f3924 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:09.104407 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f7ed5-0760-476f-9c17-ad07134f3924 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:09.104407 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f7ed5-0760-476f-9c17-ad07134f3924 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:09.105077 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 340/702] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 15:06:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:09.106877 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e44b1-2126-4028-9d37-47d098a28a0b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:09.109811 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 363/703] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Sep 23 15:06:08 2022] GET /identity/v3/services => generated 1002 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:06:09.110749 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f7ed5-0760-476f-9c17-ad07134f3924 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:09.219573 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f7ed5-0760-476f-9c17-ad07134f3924 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:09.220509 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e44b1-2126-4028-9d37-47d098a28a0b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:09.239495 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:09.261746 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8202a45-e04b-43f2-933a-76f68c0c26b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:09.262674 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8202a45-e04b-43f2-933a-76f68c0c26b2 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:09.262872 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5060a-6075-4f4b-936d-8290af2e662e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:09.263159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8202a45-e04b-43f2-933a-76f68c0c26b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:09.263519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8202a45-e04b-43f2-933a-76f68c0c26b2 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:09.264003 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5060a-6075-4f4b-936d-8290af2e662e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:09.264338 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8202a45-e04b-43f2-933a-76f68c0c26b2 None admin] RBAC: Adding query filter params (type=network) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:09.264612 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5060a-6075-4f4b-936d-8290af2e662e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:09.264805 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8202a45-e04b-43f2-933a-76f68c0c26b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:09.265157 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5060a-6075-4f4b-936d-8290af2e662e None admin] PATH_INFO: `/v3/services/image` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:09.265895 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5060a-6075-4f4b-936d-8290af2e662e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:09.266564 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8202a45-e04b-43f2-933a-76f68c0c26b2 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:09.267563 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5060a-6075-4f4b-936d-8290af2e662e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:09.277406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-33d5060a-6075-4f4b-936d-8290af2e662e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 15:06:09.277406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:09.277406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:06:09.277406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:06:09.277406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:06:09.277406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:06:09.277406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:06:09.277406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:09.277406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 15:06:09.277406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:09.277406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:06:09.277406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:09.277406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:09.277406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:09.277406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:09.277406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:09.277406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:09.278532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:09.278532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:09.278532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:09.278532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:09.278532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:09.278532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:09.278532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:06:09.278532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:06:09.278532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:06:09.278532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:06:09.278532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:09.278532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:09.278532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:09.278532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:09.278532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:09.278532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:09.279457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:09.279457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:09.279457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:09.279457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:09.279457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:09.279457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:09.279457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:09.279457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:09.279457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:09.279457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:09.279457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:06:09.279457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:09.279457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 15:06:09.279457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:09.280206 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 341/704] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 15:06:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:09.280206 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8202a45-e04b-43f2-933a-76f68c0c26b2 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:09.285911 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 364/705] 10.222.0.48 () {56 vars in 1105 bytes} [Fri Sep 23 15:06:09 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:09.288389 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5060a-6075-4f4b-936d-8290af2e662e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:09.345645 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:09.414817 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8202a45-e04b-43f2-933a-76f68c0c26b2 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:09.416817 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5060a-6075-4f4b-936d-8290af2e662e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:09.455994 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3e7ae-4ac1-418b-89ad-5da9eaba906d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:09.456878 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3e7ae-4ac1-418b-89ad-5da9eaba906d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:09.457449 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3e7ae-4ac1-418b-89ad-5da9eaba906d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:09.457880 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3e7ae-4ac1-418b-89ad-5da9eaba906d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:09.458857 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3e7ae-4ac1-418b-89ad-5da9eaba906d None admin] RBAC: Adding query filter params (interface=public, service_id=5dad554917814f27aa92c781b1c3378a, region_id=RegionOne) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:09.459199 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3e7ae-4ac1-418b-89ad-5da9eaba906d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:09.460822 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3e7ae-4ac1-418b-89ad-5da9eaba906d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:09.461980 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee0430-bc87-4b6d-a062-e3e8bbaa9884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:09.462867 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee0430-bc87-4b6d-a062-e3e8bbaa9884 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:09.463152 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee0430-bc87-4b6d-a062-e3e8bbaa9884 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:09.463421 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee0430-bc87-4b6d-a062-e3e8bbaa9884 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:09.464103 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee0430-bc87-4b6d-a062-e3e8bbaa9884 None admin] RBAC: Adding query filter params (name=image) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:09.464405 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee0430-bc87-4b6d-a062-e3e8bbaa9884 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:09.466332 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee0430-bc87-4b6d-a062-e3e8bbaa9884 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:09.469826 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 342/706] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Sep 23 15:06:09 2022] GET /identity/v3/endpoints?service_id=5dad554917814f27aa92c781b1c3378a&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:09.475153 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3e7ae-4ac1-418b-89ad-5da9eaba906d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:09.476126 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 365/707] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:06:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:09.481853 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee0430-bc87-4b6d-a062-e3e8bbaa9884 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:09.537906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:09.582007 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee0430-bc87-4b6d-a062-e3e8bbaa9884 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:09.598147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:09.607798 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3e7ae-4ac1-418b-89ad-5da9eaba906d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:09.619144 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581aefb-0036-4863-b80b-12e0b6bc5e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:09.620078 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581aefb-0036-4863-b80b-12e0b6bc5e58 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:09.620643 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581aefb-0036-4863-b80b-12e0b6bc5e58 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:09.621104 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581aefb-0036-4863-b80b-12e0b6bc5e58 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:09.621982 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581aefb-0036-4863-b80b-12e0b6bc5e58 None admin] RBAC: Adding query filter params (type=image) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:09.622501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581aefb-0036-4863-b80b-12e0b6bc5e58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:09.624283 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581aefb-0036-4863-b80b-12e0b6bc5e58 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:09.634180 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 366/708] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:06:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:09.637451 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581aefb-0036-4863-b80b-12e0b6bc5e58 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:09.649581 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112cf53-2a06-4c0c-8e98-6c6612f56f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:09.650256 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112cf53-2a06-4c0c-8e98-6c6612f56f3f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:09.650527 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112cf53-2a06-4c0c-8e98-6c6612f56f3f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:09.650796 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112cf53-2a06-4c0c-8e98-6c6612f56f3f None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:09.651409 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112cf53-2a06-4c0c-8e98-6c6612f56f3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:09.653476 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112cf53-2a06-4c0c-8e98-6c6612f56f3f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:09.665912 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 343/709] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Sep 23 15:06:09 2022] GET /identity/v3/services => generated 1002 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:06:09.756006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581aefb-0036-4863-b80b-12e0b6bc5e58 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:09.792863 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f708a-fba2-4e10-8db0-13d0279f0b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:09.793529 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f708a-fba2-4e10-8db0-13d0279f0b4d None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:09.793784 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f708a-fba2-4e10-8db0-13d0279f0b4d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:09.794057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f708a-fba2-4e10-8db0-13d0279f0b4d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:09.794761 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f708a-fba2-4e10-8db0-13d0279f0b4d None admin] RBAC: Adding query filter params (interface=public, service_id=fd9fca98e06b48c3821f96a15414523d, region_id=RegionOne) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:09.795063 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f708a-fba2-4e10-8db0-13d0279f0b4d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:09.796435 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f708a-fba2-4e10-8db0-13d0279f0b4d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:09.802699 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 367/710] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Sep 23 15:06:09 2022] GET /identity/v3/endpoints?service_id=fd9fca98e06b48c3821f96a15414523d&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:09.808488 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112cf53-2a06-4c0c-8e98-6c6612f56f3f None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:09.926679 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112cf53-2a06-4c0c-8e98-6c6612f56f3f None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:09.936022 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:09.961643 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097339ea-1efc-4b5c-af75-543df6a6ee3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:09.962281 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097339ea-1efc-4b5c-af75-543df6a6ee3d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:09.962558 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097339ea-1efc-4b5c-af75-543df6a6ee3d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:09.962831 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097339ea-1efc-4b5c-af75-543df6a6ee3d None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:09.963446 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097339ea-1efc-4b5c-af75-543df6a6ee3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:09.964883 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097339ea-1efc-4b5c-af75-543df6a6ee3d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:09.970712 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 344/711] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Sep 23 15:06:09 2022] GET /identity/v3/services => generated 1002 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:06:10.101186 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab226b8-8783-42a5-b5a1-ff48cf6aa492 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:10.101526 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab226b8-8783-42a5-b5a1-ff48cf6aa492 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:10.101812 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab226b8-8783-42a5-b5a1-ff48cf6aa492 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:10.103435 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 368/712] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:10.109631 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5f7d9-5b4c-459c-a06c-f3794bbf4e70 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:10.110254 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5f7d9-5b4c-459c-a06c-f3794bbf4e70 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:10.110753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5f7d9-5b4c-459c-a06c-f3794bbf4e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:10.133730 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-e1e5f7d9-5b4c-459c-a06c-f3794bbf4e70 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:10.133730 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-e1e5f7d9-5b4c-459c-a06c-f3794bbf4e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:10.205562 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 345/713] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:10 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:06:10.529601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab226b8-8783-42a5-b5a1-ff48cf6aa492 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:10.560587 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:10.632966 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab226b8-8783-42a5-b5a1-ff48cf6aa492 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:10.666147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffeba8-29b3-49f9-ba05-a037576676e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:10.666772 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffeba8-29b3-49f9-ba05-a037576676e7 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:10.667045 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffeba8-29b3-49f9-ba05-a037576676e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:10.667310 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffeba8-29b3-49f9-ba05-a037576676e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:10.677896 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ffeba8-29b3-49f9-ba05-a037576676e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:06:10.682698 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-00ffeba8-29b3-49f9-ba05-a037576676e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:06:10.682698 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:10.682698 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:10.682698 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:10.682698 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:10.682698 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:10.682698 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:10.682698 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:10.682698 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:10.682698 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:10.682698 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:10.682698 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:10.682698 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:06:10.682698 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:06:10.682698 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:06:10.682698 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:06:10.683638 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:06:10.683638 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:06:10.683638 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:06:10.683638 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:06:10.683638 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:10.683638 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:10.683638 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:10.683638 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:10.683638 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:10.683638 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:10.683638 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:10.683638 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:10.683638 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:10.683638 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:10.683638 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:10.683638 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:10.684479 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:10.684479 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:10.684479 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:10.684479 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:10.684479 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:06:10.684479 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:06:10.684479 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:06:10.684479 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:06:10.684479 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:06:10.684479 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:06:10.684479 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:06:10.684479 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:10.684479 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 369/714] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 15:06:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:10.691025 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5f7d9-5b4c-459c-a06c-f3794bbf4e70 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:10.791007 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5f7d9-5b4c-459c-a06c-f3794bbf4e70 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:10.794083 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:10.826959 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c8753-df8c-4b37-9579-339a1be88754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:10.827586 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c8753-df8c-4b37-9579-339a1be88754 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:10.827847 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c8753-df8c-4b37-9579-339a1be88754 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:10.828083 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c8753-df8c-4b37-9579-339a1be88754 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:10.828748 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c8753-df8c-4b37-9579-339a1be88754 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:10.829044 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c8753-df8c-4b37-9579-339a1be88754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:10.830441 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c8753-df8c-4b37-9579-339a1be88754 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:10.843468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 346/715] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:06:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:10.844861 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffeba8-29b3-49f9-ba05-a037576676e7 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:10.945270 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:10.954226 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffeba8-29b3-49f9-ba05-a037576676e7 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:10.988368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b615f-04fc-429d-b9fe-2343b3fdd574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:10.989002 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b615f-04fc-429d-b9fe-2343b3fdd574 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:10.989277 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b615f-04fc-429d-b9fe-2343b3fdd574 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:10.989544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b615f-04fc-429d-b9fe-2343b3fdd574 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:11.000541 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b615f-04fc-429d-b9fe-2343b3fdd574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:11.002020 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b615f-04fc-429d-b9fe-2343b3fdd574 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:11.016362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-507b615f-04fc-429d-b9fe-2343b3fdd574 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:06:11.016362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:11.016362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:11.016362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:11.016362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:11.016362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:11.016362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:11.016362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:11.016362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:11.016362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:11.016362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:11.016362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:11.016362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:06:11.016362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:06:11.016362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:06:11.016362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:06:11.017303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:11.017303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:11.017303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:11.017303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:11.017303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:11.017303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:11.017303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:11.017303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:11.017303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:11.017303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:11.017303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:11.017303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:11.017303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:11.017303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:11.017303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:11.017303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:11.017303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:06:11.018369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:06:11.018369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:06:11.018369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:11.018369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 370/716] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:11.024611 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c8753-df8c-4b37-9579-339a1be88754 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:11.133473 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c8753-df8c-4b37-9579-339a1be88754 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:11.168105 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653f02f-7e6a-4bd1-a16c-5f86a688e148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:11.169101 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653f02f-7e6a-4bd1-a16c-5f86a688e148 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:11.169588 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653f02f-7e6a-4bd1-a16c-5f86a688e148 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:11.170069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653f02f-7e6a-4bd1-a16c-5f86a688e148 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:11.170986 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653f02f-7e6a-4bd1-a16c-5f86a688e148 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:11.171476 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653f02f-7e6a-4bd1-a16c-5f86a688e148 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:11.173031 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653f02f-7e6a-4bd1-a16c-5f86a688e148 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:11.190889 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 347/717] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:11.192568 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b615f-04fc-429d-b9fe-2343b3fdd574 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:11.302257 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b615f-04fc-429d-b9fe-2343b3fdd574 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:11.336371 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe9c7e-1966-4414-9a0d-bcef8f9bd1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:11.337177 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe9c7e-1966-4414-9a0d-bcef8f9bd1d7 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:11.337458 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe9c7e-1966-4414-9a0d-bcef8f9bd1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:11.337754 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe9c7e-1966-4414-9a0d-bcef8f9bd1d7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:11.345473 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe9c7e-1966-4414-9a0d-bcef8f9bd1d7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:11.346997 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe9c7e-1966-4414-9a0d-bcef8f9bd1d7 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:11.358808 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-22fe9c7e-1966-4414-9a0d-bcef8f9bd1d7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:06:11.358808 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:11.358808 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:11.358808 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:11.358808 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:11.358808 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:11.358808 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:11.358808 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:11.358808 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:11.358808 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:11.358808 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:11.358808 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:11.358808 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:06:11.358808 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:06:11.358808 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:06:11.358808 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:06:11.359765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:11.359765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:11.359765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:06:11.359765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:06:11.359765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:06:11.359765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:06:11.359765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:11.359765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:11.359765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:11.359765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:11.359765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:11.359765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:11.359765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:11.359765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:11.359765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:11.359765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:11.359765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:11.359765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:11.360895 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:11.360895 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:11.360895 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:06:11.360895 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:06:11.360895 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:06:11.360895 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:06:11.360895 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:06:11.360895 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:06:11.360895 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:06:11.360895 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:11.360895 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 371/718] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Sep 23 15:06:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:11.367796 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653f02f-7e6a-4bd1-a16c-5f86a688e148 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:11.393638 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:11.469878 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653f02f-7e6a-4bd1-a16c-5f86a688e148 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:11.504919 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7826b6-ab8b-43e1-924a-8214515adb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:11.505534 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7826b6-ab8b-43e1-924a-8214515adb14 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:11.505862 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7826b6-ab8b-43e1-924a-8214515adb14 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:11.506215 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7826b6-ab8b-43e1-924a-8214515adb14 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:11.506945 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7826b6-ab8b-43e1-924a-8214515adb14 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:11.507253 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7826b6-ab8b-43e1-924a-8214515adb14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:11.508772 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7826b6-ab8b-43e1-924a-8214515adb14 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:11.526958 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 348/719] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Sep 23 15:06:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:11.532625 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe9c7e-1966-4414-9a0d-bcef8f9bd1d7 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:11.536746 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:11.637767 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe9c7e-1966-4414-9a0d-bcef8f9bd1d7 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:11.644208 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610aaae-96e9-4c98-aa1e-3288ec5d1b43 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:11.644432 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610aaae-96e9-4c98-aa1e-3288ec5d1b43 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:11.644701 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610aaae-96e9-4c98-aa1e-3288ec5d1b43 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:11.646335 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 349/720] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:11.651243 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fefa02-8cd8-4d3c-baab-63902a92da57 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:11.651527 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fefa02-8cd8-4d3c-baab-63902a92da57 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:11.651795 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fefa02-8cd8-4d3c-baab-63902a92da57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:11.671735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f7fec-8529-4a08-abc5-e507ed1820d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:11.672164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-96fefa02-8cd8-4d3c-baab-63902a92da57 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:11.672339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f7fec-8529-4a08-abc5-e507ed1820d9 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:11.672600 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f7fec-8529-4a08-abc5-e507ed1820d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:11.672861 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f7fec-8529-4a08-abc5-e507ed1820d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:11.673381 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-96fefa02-8cd8-4d3c-baab-63902a92da57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:11.754781 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 350/721] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:11 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:06:11.760687 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f7fec-8529-4a08-abc5-e507ed1820d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:11.762457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f7fec-8529-4a08-abc5-e507ed1820d9 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:11.765855 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:11.891044 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 372/722] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:06:11 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:06:11.898952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fefa02-8cd8-4d3c-baab-63902a92da57 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:11.915862 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:12.008282 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fefa02-8cd8-4d3c-baab-63902a92da57 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:12.044465 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed6a47-0f54-4ef9-a0dc-86c9c7f91c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:12.045420 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed6a47-0f54-4ef9-a0dc-86c9c7f91c0e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:12.045909 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed6a47-0f54-4ef9-a0dc-86c9c7f91c0e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:12.046344 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed6a47-0f54-4ef9-a0dc-86c9c7f91c0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:12.058822 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed6a47-0f54-4ef9-a0dc-86c9c7f91c0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:12.060544 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed6a47-0f54-4ef9-a0dc-86c9c7f91c0e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:12.077185 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-82ed6a47-0f54-4ef9-a0dc-86c9c7f91c0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:06:12.077185 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:12.077185 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:12.077185 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:12.077185 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:12.077185 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:12.077185 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:12.077185 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:12.077185 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:12.077185 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:12.077185 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:12.077185 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:12.077185 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:06:12.077185 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:06:12.077185 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:06:12.077185 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:06:12.078467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:12.078467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:12.078467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:12.078467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:12.078467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:12.078467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:12.078467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:12.078467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:12.078467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:12.078467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:12.078467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:12.078467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:12.078467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:12.078467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:12.078467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:12.078467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:12.078467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:06:12.079609 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:06:12.079609 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:06:12.079609 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:12.079846 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f7fec-8529-4a08-abc5-e507ed1820d9 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:12.082478 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 351/723] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:12.088940 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed6a47-0f54-4ef9-a0dc-86c9c7f91c0e None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:12.169100 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:12.197538 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f7fec-8529-4a08-abc5-e507ed1820d9 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:12.199944 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:12.211399 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed6a47-0f54-4ef9-a0dc-86c9c7f91c0e None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:12.238694 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7285534-d909-488c-9db8-0693f9500b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:12.239797 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7285534-d909-488c-9db8-0693f9500b9d None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:12.240255 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7285534-d909-488c-9db8-0693f9500b9d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:12.240694 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7285534-d909-488c-9db8-0693f9500b9d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:12.242067 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7285534-d909-488c-9db8-0693f9500b9d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:12.243407 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7285534-d909-488c-9db8-0693f9500b9d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:12.251351 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce8af2-18e4-42b6-8579-18c09229b122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:12.251963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce8af2-18e4-42b6-8579-18c09229b122 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:12.252249 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce8af2-18e4-42b6-8579-18c09229b122 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:12.252488 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce8af2-18e4-42b6-8579-18c09229b122 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:12.253125 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce8af2-18e4-42b6-8579-18c09229b122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:12.253418 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce8af2-18e4-42b6-8579-18c09229b122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:12.253735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-e7285534-d909-488c-9db8-0693f9500b9d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 15:06:12.253735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:12.253735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:06:12.253735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:06:12.253735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:06:12.253735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:06:12.253735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:06:12.253735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:12.253735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 15:06:12.253735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:12.253735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:06:12.253735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:12.253735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:12.253735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:12.253735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:12.253735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:12.253735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:12.254685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:12.254685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:12.254685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:12.254685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:12.254685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:12.254685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:12.254685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:06:12.254685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:06:12.254685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:06:12.254685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:06:12.254685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:12.254685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:12.254685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:12.254685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:12.254685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:12.254685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:12.255776 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:12.255776 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:12.255776 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:12.255776 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:12.255776 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:12.255776 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:12.255776 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:12.255776 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:12.255776 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:12.255776 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:12.255776 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:06:12.255776 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:12.255776 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 15:06:12.255776 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:12.256533 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce8af2-18e4-42b6-8579-18c09229b122 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:12.260187 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 373/724] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Sep 23 15:06:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:12.261504 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e4615-a182-4722-83b8-9bdfdaaf8735 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:12.261824 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e4615-a182-4722-83b8-9bdfdaaf8735 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:12.262059 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e4615-a182-4722-83b8-9bdfdaaf8735 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:12.266153 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 374/725] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:12.266153 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e4615-a182-4722-83b8-9bdfdaaf8735 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:12.269575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 352/726] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:12.275499 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7b301-953e-48a3-9034-5a58a1ba5399 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:12.275782 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7b301-953e-48a3-9034-5a58a1ba5399 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:12.276055 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7b301-953e-48a3-9034-5a58a1ba5399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:12.296756 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-fad7b301-953e-48a3-9034-5a58a1ba5399 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:12.298005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-fad7b301-953e-48a3-9034-5a58a1ba5399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:12.381787 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e4615-a182-4722-83b8-9bdfdaaf8735 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:12.419327 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abd722-9f93-40d0-a897-2fc4aded97c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:12.419871 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abd722-9f93-40d0-a897-2fc4aded97c6 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:12.420181 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abd722-9f93-40d0-a897-2fc4aded97c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:12.420474 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abd722-9f93-40d0-a897-2fc4aded97c6 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:12.421131 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abd722-9f93-40d0-a897-2fc4aded97c6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:12.421450 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abd722-9f93-40d0-a897-2fc4aded97c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:12.422948 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abd722-9f93-40d0-a897-2fc4aded97c6 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:12.433097 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 375/727] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Sep 23 15:06:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:12.433097 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abd722-9f93-40d0-a897-2fc4aded97c6 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:12.468152 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:12.492084 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 353/728] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:12 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:06:12.492930 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7b301-953e-48a3-9034-5a58a1ba5399 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:12.538471 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abd722-9f93-40d0-a897-2fc4aded97c6 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:12.548539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:12.575845 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d8066-f7f0-49b0-b52a-f7a7ffeb3864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:12.576484 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d8066-f7f0-49b0-b52a-f7a7ffeb3864 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:12.576794 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d8066-f7f0-49b0-b52a-f7a7ffeb3864 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:12.577145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d8066-f7f0-49b0-b52a-f7a7ffeb3864 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:12.584735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d8066-f7f0-49b0-b52a-f7a7ffeb3864 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:12.586455 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d8066-f7f0-49b0-b52a-f7a7ffeb3864 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:12.597429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7b301-953e-48a3-9034-5a58a1ba5399 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:12.598858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-f93d8066-f7f0-49b0-b52a-f7a7ffeb3864 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:06:12.598858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:12.598858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:12.598858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:12.598858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:12.598858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:12.598858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:12.598858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:12.598858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:12.598858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:12.598858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:12.598858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:12.598858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:06:12.598858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:06:12.598858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:06:12.599738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:06:12.599738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:12.599738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:12.599738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:12.599738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:12.599738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:12.599738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:12.599738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:12.599738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:12.599738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:12.599738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:12.599738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:12.599738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:12.599738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:12.599738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:12.599738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:12.599738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:12.600637 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:06:12.600637 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:06:12.600637 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:06:12.600637 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:06:12.600637 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:06:12.600637 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:06:12.600637 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:06:12.600637 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:12.600637 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 376/729] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:06:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:12.601565 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dd76e-1f4b-4732-aa51-faca46f04b07 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:12.601565 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dd76e-1f4b-4732-aa51-faca46f04b07 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:12.601875 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dd76e-1f4b-4732-aa51-faca46f04b07 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:12.607442 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 377/730] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:12.608190 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dd76e-1f4b-4732-aa51-faca46f04b07 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:12.637333 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd41e10-2af5-4197-886d-00ef073c22c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:12.638061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd41e10-2af5-4197-886d-00ef073c22c6 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:12.638334 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd41e10-2af5-4197-886d-00ef073c22c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:12.638650 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd41e10-2af5-4197-886d-00ef073c22c6 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:12.639298 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd41e10-2af5-4197-886d-00ef073c22c6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:12.639618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd41e10-2af5-4197-886d-00ef073c22c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:12.640971 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd41e10-2af5-4197-886d-00ef073c22c6 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:12.650512 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 354/731] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Sep 23 15:06:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:12.651771 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa70d1-40ec-410e-8dd9-2eab0359383a None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:12.652053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa70d1-40ec-410e-8dd9-2eab0359383a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:12.652332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa70d1-40ec-410e-8dd9-2eab0359383a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:12.670448 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-2cfa70d1-40ec-410e-8dd9-2eab0359383a None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:12.671546 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-2cfa70d1-40ec-410e-8dd9-2eab0359383a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:12.704791 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:12.719578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dd76e-1f4b-4732-aa51-faca46f04b07 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:12.749924 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 355/732] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:12 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:06:12.750732 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa70d1-40ec-410e-8dd9-2eab0359383a None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:12.764264 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceebc28-81e9-4e28-bb62-7879eb5bafc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:12.764883 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceebc28-81e9-4e28-bb62-7879eb5bafc8 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:12.765160 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceebc28-81e9-4e28-bb62-7879eb5bafc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:12.765429 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceebc28-81e9-4e28-bb62-7879eb5bafc8 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:12.766157 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceebc28-81e9-4e28-bb62-7879eb5bafc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:12.766459 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceebc28-81e9-4e28-bb62-7879eb5bafc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:12.768078 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceebc28-81e9-4e28-bb62-7879eb5bafc8 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:12.786286 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 378/733] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 15:06:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:12.788636 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceebc28-81e9-4e28-bb62-7879eb5bafc8 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:12.813657 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:12.866756 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa70d1-40ec-410e-8dd9-2eab0359383a None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:12.897737 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceebc28-81e9-4e28-bb62-7879eb5bafc8 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:12.900705 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e24fb-851a-42bf-8b30-e4b6b5e70ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:12.901311 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e24fb-851a-42bf-8b30-e4b6b5e70ff8 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:12.901582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e24fb-851a-42bf-8b30-e4b6b5e70ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:12.901879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e24fb-851a-42bf-8b30-e4b6b5e70ff8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:12.902543 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e24fb-851a-42bf-8b30-e4b6b5e70ff8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:12.903898 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e24fb-851a-42bf-8b30-e4b6b5e70ff8 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:12.933817 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 356/734] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 15:06:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:06:12.933817 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e24fb-851a-42bf-8b30-e4b6b5e70ff8 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:12.951176 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0867a7-75fe-4c84-8a2a-f5bbaa66e744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:12.951809 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0867a7-75fe-4c84-8a2a-f5bbaa66e744 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:12.952165 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0867a7-75fe-4c84-8a2a-f5bbaa66e744 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:12.952433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0867a7-75fe-4c84-8a2a-f5bbaa66e744 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:12.953254 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0867a7-75fe-4c84-8a2a-f5bbaa66e744 None admin] RBAC: Adding query filter params (role.id=07d4069c848d4ee9abb586256ee26f20, scope.project.id=1fd85e9620ea42a69363d006d715ad04, user.id=542c7a84dd044588a42a9e3414cab516) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:12.953640 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0867a7-75fe-4c84-8a2a-f5bbaa66e744 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:12.955302 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0867a7-75fe-4c84-8a2a-f5bbaa66e744 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:12.962342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 379/735] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:06:12 2022] GET /identity/v3/role_assignments?user.id=542c7a84dd044588a42a9e3414cab516&scope.project.id=1fd85e9620ea42a69363d006d715ad04&role.id=07d4069c848d4ee9abb586256ee26f20 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:13.049936 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e24fb-851a-42bf-8b30-e4b6b5e70ff8 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:13.052773 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:13.066326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0867a7-75fe-4c84-8a2a-f5bbaa66e744 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:13.094096 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:13.106732 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7960783-5d8f-44c1-8c50-78fbc7769354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:13.107670 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7960783-5d8f-44c1-8c50-78fbc7769354 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:13.108133 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7960783-5d8f-44c1-8c50-78fbc7769354 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:13.108554 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7960783-5d8f-44c1-8c50-78fbc7769354 None admin] PATH_INFO: `/v3/services/network` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:13.109309 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7960783-5d8f-44c1-8c50-78fbc7769354 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:13.110939 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7960783-5d8f-44c1-8c50-78fbc7769354 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:13.121076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-a7960783-5d8f-44c1-8c50-78fbc7769354 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 15:06:13.121076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:13.121076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:06:13.121076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:06:13.121076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:06:13.121076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:06:13.121076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:06:13.121076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:13.121076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 15:06:13.121076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:13.121076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:06:13.121076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:13.121076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:13.121076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:13.121076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:13.121076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:13.121076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:13.122444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:13.122444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:13.122444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:13.122444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:13.122444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:13.122444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:13.122444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:06:13.122444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:06:13.122444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:06:13.122444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:06:13.122444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:13.122444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:13.122444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:13.122444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:13.122444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:13.122444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:13.123303 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:13.123303 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:13.123303 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:13.123303 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:13.123303 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:13.123303 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:13.123303 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:13.123303 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:13.123303 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:13.123303 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:13.123303 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:06:13.123303 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:13.123303 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 15:06:13.123303 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:13.126140 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 357/736] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:06:12 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:13.133765 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7960783-5d8f-44c1-8c50-78fbc7769354 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:13.203826 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0867a7-75fe-4c84-8a2a-f5bbaa66e744 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:13.242605 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf73ab-4a85-4c84-b7d7-9f83a8d64433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:13.243240 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf73ab-4a85-4c84-b7d7-9f83a8d64433 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:13.243517 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf73ab-4a85-4c84-b7d7-9f83a8d64433 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:13.243788 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf73ab-4a85-4c84-b7d7-9f83a8d64433 None admin] PATH_INFO: `/v3/services/image` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:13.244368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf73ab-4a85-4c84-b7d7-9f83a8d64433 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:13.245744 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf73ab-4a85-4c84-b7d7-9f83a8d64433 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:13.251935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7960783-5d8f-44c1-8c50-78fbc7769354 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:13.256065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-a8bf73ab-4a85-4c84-b7d7-9f83a8d64433 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 15:06:13.256065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:13.256065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:06:13.256065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:06:13.256065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:06:13.256065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:06:13.256065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:06:13.256065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:13.256065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 15:06:13.256065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:13.256065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:06:13.256065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:13.256065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:13.256065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:13.256065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:13.256065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:13.256065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:13.257050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:13.257050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:13.257050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:13.257050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:13.257050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:13.257050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:13.257050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:06:13.257050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:06:13.257050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:06:13.257050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:06:13.257050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:13.257050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:13.257050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:13.257050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:13.257050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:13.257050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:13.257971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:13.257971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:13.257971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:13.257971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:13.257971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:13.257971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:13.257971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:13.257971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:13.257971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:13.257971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:13.257971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:06:13.257971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:13.257971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 15:06:13.257971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:13.257971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 380/737] 10.222.0.48 () {56 vars in 1105 bytes} [Fri Sep 23 15:06:13 2022] GET /identity/v3/services/image => generated 86 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:13.264519 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf73ab-4a85-4c84-b7d7-9f83a8d64433 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:13.291805 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddb2d1-850f-45a4-8605-c581be747b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:13.292419 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddb2d1-850f-45a4-8605-c581be747b5d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:13.292691 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddb2d1-850f-45a4-8605-c581be747b5d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:13.293069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddb2d1-850f-45a4-8605-c581be747b5d None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:13.293716 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddb2d1-850f-45a4-8605-c581be747b5d None admin] RBAC: Adding query filter params (name=network) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:13.294930 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddb2d1-850f-45a4-8605-c581be747b5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:13.296537 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddb2d1-850f-45a4-8605-c581be747b5d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:13.302968 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 358/738] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 15:06:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:13.308805 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddb2d1-850f-45a4-8605-c581be747b5d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:13.348230 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:13.367447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:13.395036 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf73ab-4a85-4c84-b7d7-9f83a8d64433 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:13.436289 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddb2d1-850f-45a4-8605-c581be747b5d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:13.440599 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d492b10-0aa4-4ed6-be84-f6d5471b3ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:13.441411 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d492b10-0aa4-4ed6-be84-f6d5471b3ee9 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:13.441868 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d492b10-0aa4-4ed6-be84-f6d5471b3ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:13.442314 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d492b10-0aa4-4ed6-be84-f6d5471b3ee9 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:13.443077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d492b10-0aa4-4ed6-be84-f6d5471b3ee9 None admin] RBAC: Adding query filter params (name=image) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:13.443539 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d492b10-0aa4-4ed6-be84-f6d5471b3ee9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:13.445649 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d492b10-0aa4-4ed6-be84-f6d5471b3ee9 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:13.457142 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 381/739] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:06:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:13.458583 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d492b10-0aa4-4ed6-be84-f6d5471b3ee9 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:13.479398 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f286514-3ece-4be5-bed5-d2e5ee6c6e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:13.480155 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f286514-3ece-4be5-bed5-d2e5ee6c6e32 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:13.480532 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f286514-3ece-4be5-bed5-d2e5ee6c6e32 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:13.481293 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f286514-3ece-4be5-bed5-d2e5ee6c6e32 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:13.481995 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f286514-3ece-4be5-bed5-d2e5ee6c6e32 None admin] RBAC: Adding query filter params (type=network) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:13.482476 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f286514-3ece-4be5-bed5-d2e5ee6c6e32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:13.483958 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f286514-3ece-4be5-bed5-d2e5ee6c6e32 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:13.493998 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 359/740] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 15:06:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:13.496310 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f286514-3ece-4be5-bed5-d2e5ee6c6e32 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:13.576649 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d492b10-0aa4-4ed6-be84-f6d5471b3ee9 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:13.615341 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:13.620025 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f286514-3ece-4be5-bed5-d2e5ee6c6e32 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:13.621171 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a83219-1974-4f11-bdae-fa924e8d34cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:13.622169 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a83219-1974-4f11-bdae-fa924e8d34cf None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:13.623383 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a83219-1974-4f11-bdae-fa924e8d34cf None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:13.623819 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a83219-1974-4f11-bdae-fa924e8d34cf None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:13.624608 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a83219-1974-4f11-bdae-fa924e8d34cf None admin] RBAC: Adding query filter params (type=image) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:13.625102 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a83219-1974-4f11-bdae-fa924e8d34cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:13.626640 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a83219-1974-4f11-bdae-fa924e8d34cf None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:13.633718 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 382/741] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:06:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:13.638915 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a83219-1974-4f11-bdae-fa924e8d34cf None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:13.644399 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:13.663679 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7b8e7-240a-470c-8a81-54d7c42df6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:13.664390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7b8e7-240a-470c-8a81-54d7c42df6ed None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:13.664684 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7b8e7-240a-470c-8a81-54d7c42df6ed None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:13.664973 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7b8e7-240a-470c-8a81-54d7c42df6ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:13.666071 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7b8e7-240a-470c-8a81-54d7c42df6ed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:13.668517 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7b8e7-240a-470c-8a81-54d7c42df6ed None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:13.701719 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 360/742] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 15:06:13 2022] POST /identity/v3/endpoints => generated 337 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:06:13.767767 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a83219-1974-4f11-bdae-fa924e8d34cf None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:13.814836 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2154d-9d8d-4867-9a1a-b2dae887f185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:13.815509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2154d-9d8d-4867-9a1a-b2dae887f185 None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:13.815792 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2154d-9d8d-4867-9a1a-b2dae887f185 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:13.816065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2154d-9d8d-4867-9a1a-b2dae887f185 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:13.816799 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2154d-9d8d-4867-9a1a-b2dae887f185 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:13.818239 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2154d-9d8d-4867-9a1a-b2dae887f185 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:13.843437 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 383/743] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 15:06:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:06:15.467561 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb695ed7-9b81-49e9-9878-dfc645371516 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:15.468106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb695ed7-9b81-49e9-9878-dfc645371516 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:15.468106 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb695ed7-9b81-49e9-9878-dfc645371516 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:15.469581 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 361/744] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:15.474813 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb867fe8-e207-4c2a-9655-0f12b220e2f8 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:15.475221 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb867fe8-e207-4c2a-9655-0f12b220e2f8 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:15.475408 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb867fe8-e207-4c2a-9655-0f12b220e2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:15.493921 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dffaab-ed6d-4a0b-845c-5ce1b7861707 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:15.494227 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dffaab-ed6d-4a0b-845c-5ce1b7861707 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:15.494439 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dffaab-ed6d-4a0b-845c-5ce1b7861707 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:15.494727 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-bb867fe8-e207-4c2a-9655-0f12b220e2f8 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:15.495925 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 362/745] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:15.496046 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-bb867fe8-e207-4c2a-9655-0f12b220e2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:15.500547 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b2098-d01a-4d2b-8a5a-14fb2008d02b None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:15.500795 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b2098-d01a-4d2b-8a5a-14fb2008d02b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:15.501095 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b2098-d01a-4d2b-8a5a-14fb2008d02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:15.520009 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-b19b2098-d01a-4d2b-8a5a-14fb2008d02b None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:15.521170 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-b19b2098-d01a-4d2b-8a5a-14fb2008d02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:15.550052 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:15.577737 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 384/746] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:15 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:06:15.589607 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 363/747] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:15 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:06:15.888503 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb867fe8-e207-4c2a-9655-0f12b220e2f8 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:15.903055 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b2098-d01a-4d2b-8a5a-14fb2008d02b None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:15.991253 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:15.996385 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb867fe8-e207-4c2a-9655-0f12b220e2f8 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:16.012432 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b2098-d01a-4d2b-8a5a-14fb2008d02b None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:16.032961 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81a3da-b4b9-4791-a92f-4039789c516b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:16.033577 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81a3da-b4b9-4791-a92f-4039789c516b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:16.033870 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81a3da-b4b9-4791-a92f-4039789c516b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:16.034126 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81a3da-b4b9-4791-a92f-4039789c516b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:16.034702 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81a3da-b4b9-4791-a92f-4039789c516b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:16.036053 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81a3da-b4b9-4791-a92f-4039789c516b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:16.045080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-7a81a3da-b4b9-4791-a92f-4039789c516b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 15:06:16.045080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:16.045080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:06:16.045080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:06:16.045080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:06:16.045080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:06:16.045080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:06:16.045080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:16.045080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 15:06:16.045080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:16.045080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:06:16.045080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:16.045080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:16.045080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:16.045080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:16.045080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:16.046043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:16.046043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:16.046043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:16.046043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:16.046043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:16.046043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:16.046043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:16.046043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:06:16.046043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:06:16.046043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:06:16.046043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:06:16.046043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:16.046043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:16.046043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:16.046043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:16.046043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:16.046043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:16.047603 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:16.047603 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:16.047603 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:16.047603 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:16.047603 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:16.047603 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:16.047603 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:16.047603 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:16.047603 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:16.047603 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:16.047603 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:06:16.047603 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:16.047603 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 15:06:16.047603 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:16.047603 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 385/748] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Sep 23 15:06:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:16.049176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e89b3-adc4-49a6-b578-7c7983ea2d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:16.049855 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e89b3-adc4-49a6-b578-7c7983ea2d72 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:16.050131 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e89b3-adc4-49a6-b578-7c7983ea2d72 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:16.050397 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e89b3-adc4-49a6-b578-7c7983ea2d72 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:16.050975 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e89b3-adc4-49a6-b578-7c7983ea2d72 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:16.051985 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81a3da-b4b9-4791-a92f-4039789c516b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:16.053652 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e89b3-adc4-49a6-b578-7c7983ea2d72 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:16.062717 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-634e89b3-adc4-49a6-b578-7c7983ea2d72 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 15:06:16.062717 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:16.062717 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:06:16.062717 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:06:16.062717 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:06:16.062717 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:06:16.062717 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:06:16.062717 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:16.062717 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 15:06:16.062717 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:16.062717 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:06:16.062717 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:16.062717 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:16.062717 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:16.062717 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:16.062717 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:16.062717 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:16.063735 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:16.063735 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:16.063735 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:16.063735 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:16.063735 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:16.063735 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:16.063735 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:06:16.063735 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:06:16.063735 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:06:16.063735 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:06:16.063735 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:16.063735 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:16.063735 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:16.063735 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:16.063735 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:16.063735 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:16.065132 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:16.065132 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:16.065132 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:16.065132 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:16.065132 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:16.065132 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:16.065132 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:16.065132 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:16.065132 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:16.065132 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:16.065132 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:06:16.065132 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:16.065132 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 15:06:16.065132 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:16.065132 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 364/749] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 15:06:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:06:16.069375 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e89b3-adc4-49a6-b578-7c7983ea2d72 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:16.105733 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:16.162747 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81a3da-b4b9-4791-a92f-4039789c516b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:16.173267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e89b3-adc4-49a6-b578-7c7983ea2d72 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:16.197232 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad4297-30e0-4291-8a8b-017cda04f72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:16.197973 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad4297-30e0-4291-8a8b-017cda04f72d None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:16.198272 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad4297-30e0-4291-8a8b-017cda04f72d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:16.198616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad4297-30e0-4291-8a8b-017cda04f72d None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:16.199228 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad4297-30e0-4291-8a8b-017cda04f72d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:16.199578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad4297-30e0-4291-8a8b-017cda04f72d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:16.201047 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad4297-30e0-4291-8a8b-017cda04f72d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:16.205790 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 386/750] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Sep 23 15:06:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:16.206125 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af399db3-97da-4fcd-bc50-8f1ec80f498f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:16.206797 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af399db3-97da-4fcd-bc50-8f1ec80f498f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:16.207071 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af399db3-97da-4fcd-bc50-8f1ec80f498f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:16.207341 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af399db3-97da-4fcd-bc50-8f1ec80f498f None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:16.207961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af399db3-97da-4fcd-bc50-8f1ec80f498f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:16.208251 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af399db3-97da-4fcd-bc50-8f1ec80f498f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:16.209614 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af399db3-97da-4fcd-bc50-8f1ec80f498f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:16.211559 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad4297-30e0-4291-8a8b-017cda04f72d None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:16.217739 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 365/751] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 15:06:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:16.220341 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af399db3-97da-4fcd-bc50-8f1ec80f498f None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:16.233019 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:16.319897 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad4297-30e0-4291-8a8b-017cda04f72d None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:16.324121 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af399db3-97da-4fcd-bc50-8f1ec80f498f None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:16.329987 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:16.353302 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01b289-891c-4833-831c-5fe67df59484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:16.353963 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01b289-891c-4833-831c-5fe67df59484 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:16.354231 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01b289-891c-4833-831c-5fe67df59484 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:16.354493 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01b289-891c-4833-831c-5fe67df59484 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:16.355130 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01b289-891c-4833-831c-5fe67df59484 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:16.355423 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01b289-891c-4833-831c-5fe67df59484 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:16.357087 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01b289-891c-4833-831c-5fe67df59484 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:16.358396 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9017c0-bde3-4e81-8c70-259f8955883a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:16.358994 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9017c0-bde3-4e81-8c70-259f8955883a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:16.359253 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9017c0-bde3-4e81-8c70-259f8955883a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:16.359519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9017c0-bde3-4e81-8c70-259f8955883a None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:16.360134 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9017c0-bde3-4e81-8c70-259f8955883a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:16.360428 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9017c0-bde3-4e81-8c70-259f8955883a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:16.361288 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 387/752] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Sep 23 15:06:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:16.361789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9017c0-bde3-4e81-8c70-259f8955883a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:16.362479 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbba05-57bb-4288-aadd-c2ac9ba22459 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:16.362761 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbba05-57bb-4288-aadd-c2ac9ba22459 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:16.363022 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbba05-57bb-4288-aadd-c2ac9ba22459 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:16.364369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 388/753] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:16.376986 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 366/754] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 15:06:16 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:16.377219 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6e8e4-d4c5-4984-950b-4b0dd569a022 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:16.377219 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6e8e4-d4c5-4984-950b-4b0dd569a022 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:16.377219 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6e8e4-d4c5-4984-950b-4b0dd569a022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:16.392118 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-a0d6e8e4-d4c5-4984-950b-4b0dd569a022 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:16.393486 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-a0d6e8e4-d4c5-4984-950b-4b0dd569a022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:16.473249 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 389/755] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:16 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:06:16.785124 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9017c0-bde3-4e81-8c70-259f8955883a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:16.866137 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:16.898624 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9017c0-bde3-4e81-8c70-259f8955883a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:16.932664 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a39fa-de22-4d40-8d10-45aa938b018b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:16.933268 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a39fa-de22-4d40-8d10-45aa938b018b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:16.933602 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a39fa-de22-4d40-8d10-45aa938b018b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:16.933892 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a39fa-de22-4d40-8d10-45aa938b018b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:17.000692 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a39fa-de22-4d40-8d10-45aa938b018b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:17.002079 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a39fa-de22-4d40-8d10-45aa938b018b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:17.072584 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:17.100505 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 367/756] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:06:16 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:06:17.106509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6e8e4-d4c5-4984-950b-4b0dd569a022 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:17.209987 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6e8e4-d4c5-4984-950b-4b0dd569a022 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:17.212360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:17.245397 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e672a-f592-4b45-9bdb-6879d7a6e254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:17.246054 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e672a-f592-4b45-9bdb-6879d7a6e254 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:17.246331 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e672a-f592-4b45-9bdb-6879d7a6e254 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:17.246597 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e672a-f592-4b45-9bdb-6879d7a6e254 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:17.256469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e672a-f592-4b45-9bdb-6879d7a6e254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:17.257921 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e672a-f592-4b45-9bdb-6879d7a6e254 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:17.272145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-d03e672a-f592-4b45-9bdb-6879d7a6e254 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:06:17.272145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:17.272145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:17.272145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:17.272145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:17.272145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:17.272145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:17.272145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:17.272145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:17.272145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:17.272145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:17.272145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:17.272145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:06:17.272145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:06:17.272145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:06:17.272145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:06:17.273197 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:17.273197 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:17.273197 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:17.273197 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:17.273197 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:17.273197 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:17.273197 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:17.273197 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:17.273197 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:17.273197 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:17.273197 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:17.273197 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:17.273197 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:17.273197 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:17.273197 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:17.273197 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:17.273197 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:06:17.279421 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:06:17.279421 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:06:17.279421 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:17.279421 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 390/757] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:17.279647 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a39fa-de22-4d40-8d10-45aa938b018b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:17.377617 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a39fa-de22-4d40-8d10-45aa938b018b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:17.410798 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b6744-be6b-405a-a350-00a0978f8207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:17.411403 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b6744-be6b-405a-a350-00a0978f8207 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:17.411677 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b6744-be6b-405a-a350-00a0978f8207 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:17.411949 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b6744-be6b-405a-a350-00a0978f8207 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:17.412578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b6744-be6b-405a-a350-00a0978f8207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:17.412876 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b6744-be6b-405a-a350-00a0978f8207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:17.414319 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b6744-be6b-405a-a350-00a0978f8207 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:17.426969 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 368/758] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:18.756851 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e97990-01b1-48cb-b322-d07fae3a29ea None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:18.757439 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e97990-01b1-48cb-b322-d07fae3a29ea None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:18.757439 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e97990-01b1-48cb-b322-d07fae3a29ea None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:18.758740 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 391/759] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:18.764069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c385b49-45b3-4151-b963-c13643ee2245 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:18.764496 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c385b49-45b3-4151-b963-c13643ee2245 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:18.764642 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c385b49-45b3-4151-b963-c13643ee2245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:18.766403 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b1f96-e520-4604-861b-7dd39acb9572 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:18.766679 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b1f96-e520-4604-861b-7dd39acb9572 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:18.766945 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b1f96-e520-4604-861b-7dd39acb9572 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:18.768267 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 392/760] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:18.772866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e4966-82b8-4548-a106-b811006f1b42 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:18.773203 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e4966-82b8-4548-a106-b811006f1b42 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:18.773481 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e4966-82b8-4548-a106-b811006f1b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:18.783421 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-9c385b49-45b3-4151-b963-c13643ee2245 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:18.784596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-9c385b49-45b3-4151-b963-c13643ee2245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:18.793758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-5d0e4966-82b8-4548-a106-b811006f1b42 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:18.794921 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-5d0e4966-82b8-4548-a106-b811006f1b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:18.811256 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:18.851665 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 369/761] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:18 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:06:18.862241 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 393/762] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:18 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:06:19.169202 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c385b49-45b3-4151-b963-c13643ee2245 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:19.178093 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e4966-82b8-4548-a106-b811006f1b42 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:19.258912 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:19.269028 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c385b49-45b3-4151-b963-c13643ee2245 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:19.273834 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e4966-82b8-4548-a106-b811006f1b42 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:19.302251 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfde04-602a-4a67-a776-3b6482ea29a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:19.302863 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfde04-602a-4a67-a776-3b6482ea29a1 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:19.303138 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfde04-602a-4a67-a776-3b6482ea29a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:19.303406 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfde04-602a-4a67-a776-3b6482ea29a1 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:19.304064 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfde04-602a-4a67-a776-3b6482ea29a1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:19.305521 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfde04-602a-4a67-a776-3b6482ea29a1 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:19.306455 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c20d72-41b3-49e7-9a70-afee25bd64de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:19.307057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c20d72-41b3-49e7-9a70-afee25bd64de None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:19.307330 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c20d72-41b3-49e7-9a70-afee25bd64de None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:19.307592 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c20d72-41b3-49e7-9a70-afee25bd64de None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:19.308222 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c20d72-41b3-49e7-9a70-afee25bd64de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:19.309567 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c20d72-41b3-49e7-9a70-afee25bd64de None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:19.322257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 370/763] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 15:06:19 2022] POST /identity/v3/services => generated 269 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:06:19.325729 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 394/764] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 15:06:19 2022] POST /identity/v3/services => generated 251 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:06:21.725051 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31a9e0-2aef-4ca4-8061-5930806b374b None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:21.725519 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daf31f-c5e6-4cca-8976-c01c6c65e192 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:21.726078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31a9e0-2aef-4ca4-8061-5930806b374b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:21.726219 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daf31f-c5e6-4cca-8976-c01c6c65e192 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:21.726371 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31a9e0-2aef-4ca4-8061-5930806b374b None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:21.726494 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daf31f-c5e6-4cca-8976-c01c6c65e192 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:21.727120 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 395/766] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:21.727252 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 371/766] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:21.733376 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96ee70-054d-4a6d-92cf-19b111dd51ab None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:21.733545 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35ae95-859b-4289-adc4-147e37727867 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:21.733676 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96ee70-054d-4a6d-92cf-19b111dd51ab None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:21.733811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35ae95-859b-4289-adc4-147e37727867 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:21.733975 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96ee70-054d-4a6d-92cf-19b111dd51ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:21.734075 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35ae95-859b-4289-adc4-147e37727867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:21.755849 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-eb96ee70-054d-4a6d-92cf-19b111dd51ab None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:21.756863 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-6d35ae95-859b-4289-adc4-147e37727867 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:21.756997 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-eb96ee70-054d-4a6d-92cf-19b111dd51ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:21.758091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-6d35ae95-859b-4289-adc4-147e37727867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:21.777214 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:21.831065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 396/767] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:21 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:06:21.832740 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 372/768] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:21 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:06:22.151993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96ee70-054d-4a6d-92cf-19b111dd51ab None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:22.182514 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35ae95-859b-4289-adc4-147e37727867 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:22.221410 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:22.252975 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96ee70-054d-4a6d-92cf-19b111dd51ab None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:22.281566 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35ae95-859b-4289-adc4-147e37727867 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:22.286484 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3eca6-10a9-4d58-a2a7-3b46af4f7e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:22.287113 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3eca6-10a9-4d58-a2a7-3b46af4f7e5b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:22.287387 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3eca6-10a9-4d58-a2a7-3b46af4f7e5b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:22.287741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3eca6-10a9-4d58-a2a7-3b46af4f7e5b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:22.288317 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3eca6-10a9-4d58-a2a7-3b46af4f7e5b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:22.289741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3eca6-10a9-4d58-a2a7-3b46af4f7e5b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:22.298489 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-ffe3eca6-10a9-4d58-a2a7-3b46af4f7e5b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 15:06:22.298489 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:22.298489 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:06:22.298489 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:06:22.298489 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:06:22.298489 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:06:22.298489 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:06:22.298489 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:22.298489 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 15:06:22.298489 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:22.298489 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:06:22.298489 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:22.298489 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:22.298489 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:22.298489 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:22.298489 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:22.299552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:22.299552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:22.299552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:22.299552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:22.299552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:22.299552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:22.299552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:22.299552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:06:22.299552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:06:22.299552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:06:22.299552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:06:22.299552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:22.299552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:22.299552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:22.299552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:22.299552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:22.299552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:22.300769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:22.300769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:22.300769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:22.300769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:22.300769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:22.300769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:22.300769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:22.300769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:22.300769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:22.300769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:22.300769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:06:22.300769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:22.300769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 15:06:22.300769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:22.300769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 397/769] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Sep 23 15:06:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:22.305458 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3eca6-10a9-4d58-a2a7-3b46af4f7e5b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:22.315061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c38d2-1262-4766-affe-fbc187a80312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:22.315696 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c38d2-1262-4766-affe-fbc187a80312 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:22.315992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c38d2-1262-4766-affe-fbc187a80312 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:22.316248 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c38d2-1262-4766-affe-fbc187a80312 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:22.316832 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c38d2-1262-4766-affe-fbc187a80312 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:22.318222 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c38d2-1262-4766-affe-fbc187a80312 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:22.327061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-041c38d2-1262-4766-affe-fbc187a80312 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 15:06:22.327061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:22.327061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:06:22.327061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:06:22.327061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:06:22.327061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:06:22.327061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:06:22.327061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:22.327061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 15:06:22.327061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:22.327061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:06:22.327061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:22.327061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:22.327061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:22.327061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:22.327061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:22.327061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:22.328509 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:22.328509 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:22.328509 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:22.328509 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:22.328509 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:22.328509 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:22.328509 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:06:22.328509 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:06:22.328509 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:06:22.328509 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:06:22.328509 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:22.328509 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:22.328509 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:22.328509 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:22.328509 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:22.328509 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:22.329753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:22.329753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:22.329753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:22.329753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:22.329753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:22.329753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:22.329753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:22.329753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:22.329753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:22.329753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:22.329753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:06:22.329753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:22.329753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 15:06:22.329753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:22.329753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 373/770] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 15:06:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:06:22.333958 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c38d2-1262-4766-affe-fbc187a80312 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:22.349262 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:22.405163 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3eca6-10a9-4d58-a2a7-3b46af4f7e5b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:22.436278 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c38d2-1262-4766-affe-fbc187a80312 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:22.440724 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d224a9b-6829-4eb0-b755-0e9026ca131c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:22.441326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d224a9b-6829-4eb0-b755-0e9026ca131c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:22.441595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d224a9b-6829-4eb0-b755-0e9026ca131c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:22.442056 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d224a9b-6829-4eb0-b755-0e9026ca131c None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:22.442676 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d224a9b-6829-4eb0-b755-0e9026ca131c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:22.443069 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d224a9b-6829-4eb0-b755-0e9026ca131c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:22.444523 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d224a9b-6829-4eb0-b755-0e9026ca131c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:22.446433 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:22.455059 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 398/771] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Sep 23 15:06:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:22.456026 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d224a9b-6829-4eb0-b755-0e9026ca131c None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:22.470596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225a0c7-9d51-481b-a159-d6a05abe712e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:22.471232 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225a0c7-9d51-481b-a159-d6a05abe712e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:22.471508 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225a0c7-9d51-481b-a159-d6a05abe712e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:22.471776 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225a0c7-9d51-481b-a159-d6a05abe712e None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:22.472401 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225a0c7-9d51-481b-a159-d6a05abe712e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:22.472698 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225a0c7-9d51-481b-a159-d6a05abe712e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:22.474092 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225a0c7-9d51-481b-a159-d6a05abe712e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:22.479048 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 374/772] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 15:06:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:22.484921 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225a0c7-9d51-481b-a159-d6a05abe712e None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:22.554408 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d224a9b-6829-4eb0-b755-0e9026ca131c None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:22.561115 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:22.583329 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225a0c7-9d51-481b-a159-d6a05abe712e None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:22.588509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf711d-f121-41ed-afbb-06f3007a401c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:22.589177 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf711d-f121-41ed-afbb-06f3007a401c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:22.589448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf711d-f121-41ed-afbb-06f3007a401c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:22.589735 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf711d-f121-41ed-afbb-06f3007a401c None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:22.590355 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf711d-f121-41ed-afbb-06f3007a401c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:22.590649 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf711d-f121-41ed-afbb-06f3007a401c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:22.591999 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf711d-f121-41ed-afbb-06f3007a401c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:22.597073 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 399/773] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Sep 23 15:06:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:22.602641 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf711d-f121-41ed-afbb-06f3007a401c None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:22.620356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639766b-e2fb-4d51-ab5e-fa1ef29811f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:22.621062 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639766b-e2fb-4d51-ab5e-fa1ef29811f6 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:22.621334 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639766b-e2fb-4d51-ab5e-fa1ef29811f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:22.621598 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639766b-e2fb-4d51-ab5e-fa1ef29811f6 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:22.622249 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639766b-e2fb-4d51-ab5e-fa1ef29811f6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:22.622543 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639766b-e2fb-4d51-ab5e-fa1ef29811f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:22.623916 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639766b-e2fb-4d51-ab5e-fa1ef29811f6 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:22.628421 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 375/774] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 15:06:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:22.634305 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639766b-e2fb-4d51-ab5e-fa1ef29811f6 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:22.667111 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:22.704333 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf711d-f121-41ed-afbb-06f3007a401c None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:22.733518 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639766b-e2fb-4d51-ab5e-fa1ef29811f6 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:22.742521 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae55114-fcc7-4345-98bd-d4c3ca235f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:22.743138 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae55114-fcc7-4345-98bd-d4c3ca235f87 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:22.743407 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae55114-fcc7-4345-98bd-d4c3ca235f87 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:22.743662 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae55114-fcc7-4345-98bd-d4c3ca235f87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:22.744335 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae55114-fcc7-4345-98bd-d4c3ca235f87 None admin] RBAC: Adding query filter params (interface=public, service_id=cc7c27b06cb546279223b7c0c5ed5ae9, region_id=RegionOne) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:22.744634 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae55114-fcc7-4345-98bd-d4c3ca235f87 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:22.746048 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae55114-fcc7-4345-98bd-d4c3ca235f87 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:22.750832 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 400/775] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Sep 23 15:06:22 2022] GET /identity/v3/endpoints?service_id=cc7c27b06cb546279223b7c0c5ed5ae9&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:22.756560 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae55114-fcc7-4345-98bd-d4c3ca235f87 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:22.766579 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e04208-b460-4499-82df-591f4547a4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:22.767186 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e04208-b460-4499-82df-591f4547a4a5 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:22.767457 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e04208-b460-4499-82df-591f4547a4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:22.767720 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e04208-b460-4499-82df-591f4547a4a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:22.768426 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e04208-b460-4499-82df-591f4547a4a5 None admin] RBAC: Adding query filter params (interface=public, service_id=3f5f30fbbe444a878ea596cc29086a33, region_id=RegionOne) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:22.768712 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e04208-b460-4499-82df-591f4547a4a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:22.770168 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e04208-b460-4499-82df-591f4547a4a5 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:22.775088 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 376/776] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Sep 23 15:06:22 2022] GET /identity/v3/endpoints?service_id=3f5f30fbbe444a878ea596cc29086a33&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:22.780468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e04208-b460-4499-82df-591f4547a4a5 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:22.789028 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:22.852558 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae55114-fcc7-4345-98bd-d4c3ca235f87 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:22.876733 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e04208-b460-4499-82df-591f4547a4a5 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:22.878285 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:22.886994 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e17c45-bdaa-47b2-bdbc-a84439b439e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:22.887589 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e17c45-bdaa-47b2-bdbc-a84439b439e0 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:22.887858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e17c45-bdaa-47b2-bdbc-a84439b439e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:22.888119 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e17c45-bdaa-47b2-bdbc-a84439b439e0 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:22.888703 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e17c45-bdaa-47b2-bdbc-a84439b439e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:22.890089 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e17c45-bdaa-47b2-bdbc-a84439b439e0 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:22.905796 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 401/777] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Sep 23 15:06:22 2022] GET /identity/v3/services => generated 1498 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:06:22.910904 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404a2b6-e379-48e2-aa23-1d42b087a64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:22.911838 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404a2b6-e379-48e2-aa23-1d42b087a64c None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:22.912226 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404a2b6-e379-48e2-aa23-1d42b087a64c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:22.912586 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404a2b6-e379-48e2-aa23-1d42b087a64c None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:22.913379 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404a2b6-e379-48e2-aa23-1d42b087a64c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:22.915152 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404a2b6-e379-48e2-aa23-1d42b087a64c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:22.922350 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 377/778] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Sep 23 15:06:22 2022] GET /identity/v3/services => generated 1498 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:06:25.261191 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29b854-668f-40ff-a790-fe6b7dc5c063 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:25.261772 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29b854-668f-40ff-a790-fe6b7dc5c063 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:25.261772 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29b854-668f-40ff-a790-fe6b7dc5c063 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:25.263056 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 402/779] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:25.268426 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc29b17-eb01-411d-9988-5b7947f6da3c None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:25.268849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc29b17-eb01-411d-9988-5b7947f6da3c None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:25.268965 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc29b17-eb01-411d-9988-5b7947f6da3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:25.288068 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-fdc29b17-eb01-411d-9988-5b7947f6da3c None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:25.289263 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-fdc29b17-eb01-411d-9988-5b7947f6da3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:25.306115 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67cfd7-6228-4ffe-a690-ed9b87f01956 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:25.306439 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67cfd7-6228-4ffe-a690-ed9b87f01956 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:25.306734 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67cfd7-6228-4ffe-a690-ed9b87f01956 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:25.308180 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 403/780] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:25.313545 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222efff4-3395-406a-bcea-0c0514d803e4 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:25.313868 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222efff4-3395-406a-bcea-0c0514d803e4 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:25.314144 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222efff4-3395-406a-bcea-0c0514d803e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:25.332499 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-222efff4-3395-406a-bcea-0c0514d803e4 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:25.333673 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-222efff4-3395-406a-bcea-0c0514d803e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:25.356200 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:25.361810 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 378/781] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:25 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:06:25.401282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 404/782] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:25 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:06:25.677489 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc29b17-eb01-411d-9988-5b7947f6da3c None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:25.715680 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222efff4-3395-406a-bcea-0c0514d803e4 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:25.783674 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc29b17-eb01-411d-9988-5b7947f6da3c None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:25.816140 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222efff4-3395-406a-bcea-0c0514d803e4 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:25.818485 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a97e79-55ff-46cc-b6fb-18e44373d553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:25.819112 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a97e79-55ff-46cc-b6fb-18e44373d553 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:25.819467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a97e79-55ff-46cc-b6fb-18e44373d553 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:25.819741 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a97e79-55ff-46cc-b6fb-18e44373d553 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:25.820380 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a97e79-55ff-46cc-b6fb-18e44373d553 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:25.821774 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a97e79-55ff-46cc-b6fb-18e44373d553 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:25.830576 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-80a97e79-55ff-46cc-b6fb-18e44373d553 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 15:06:25.830576 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:25.830576 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:06:25.830576 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:06:25.830576 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:06:25.830576 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:06:25.830576 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:06:25.830576 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:25.830576 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 15:06:25.830576 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:25.830576 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:06:25.830576 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:25.830576 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:25.830576 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:25.830576 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:25.830576 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:25.831618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:25.831618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:25.831618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:25.831618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:25.831618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:25.831618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:25.831618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:25.831618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:06:25.831618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:06:25.831618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:06:25.831618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:06:25.831618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:25.831618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:25.831618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:25.831618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:25.831618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:25.831618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:25.832535 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:25.832535 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:25.832535 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:25.832535 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:25.832535 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:25.832535 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:25.832535 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:25.832535 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:25.832535 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:25.832535 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:25.832535 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:06:25.832535 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:25.832535 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 15:06:25.832535 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:25.832535 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 379/783] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Sep 23 15:06:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:25.837683 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a97e79-55ff-46cc-b6fb-18e44373d553 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:25.838441 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:25.851106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be91d2-5225-431f-9e1e-bd350c6700b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:25.851826 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be91d2-5225-431f-9e1e-bd350c6700b8 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:25.852104 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be91d2-5225-431f-9e1e-bd350c6700b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:25.852369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be91d2-5225-431f-9e1e-bd350c6700b8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:25.853024 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be91d2-5225-431f-9e1e-bd350c6700b8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:25.854426 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be91d2-5225-431f-9e1e-bd350c6700b8 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:25.863346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-44be91d2-5225-431f-9e1e-bd350c6700b8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 15:06:25.863346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:25.863346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:06:25.863346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:06:25.863346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:06:25.863346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:06:25.863346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:06:25.863346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:25.863346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 15:06:25.863346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:25.863346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:06:25.863346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:25.863346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:25.863346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:25.863346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:25.863346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:25.863346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:25.864524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:25.864524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:25.864524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:25.864524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:25.864524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:25.864524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:25.864524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:06:25.864524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:06:25.864524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:06:25.864524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:06:25.864524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:25.864524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:25.864524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:25.864524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:25.864524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:25.864524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:25.865369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:25.865369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:25.865369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:25.865369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:25.865369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:25.865369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:25.865369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:25.865369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:25.865369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:25.865369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:25.865369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:06:25.865369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:25.865369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 15:06:25.865369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:25.865369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 405/784] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 15:06:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:06:25.870294 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be91d2-5225-431f-9e1e-bd350c6700b8 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:25.899941 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:25.936619 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a97e79-55ff-46cc-b6fb-18e44373d553 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:25.966569 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be91d2-5225-431f-9e1e-bd350c6700b8 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:25.973530 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbc02f-f2a1-4193-8012-1aef05344acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:25.974189 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbc02f-f2a1-4193-8012-1aef05344acb None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:25.974467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbc02f-f2a1-4193-8012-1aef05344acb None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:25.974764 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbc02f-f2a1-4193-8012-1aef05344acb None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:25.975395 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbc02f-f2a1-4193-8012-1aef05344acb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:25.975693 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbc02f-f2a1-4193-8012-1aef05344acb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:25.977065 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbc02f-f2a1-4193-8012-1aef05344acb None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:25.982250 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 380/785] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Sep 23 15:06:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:25.987790 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbc02f-f2a1-4193-8012-1aef05344acb None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:25.999286 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec75c57-fe67-4c61-8724-ee9f4e66d5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:25.999871 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec75c57-fe67-4c61-8724-ee9f4e66d5f9 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:26.000140 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec75c57-fe67-4c61-8724-ee9f4e66d5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:26.000407 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec75c57-fe67-4c61-8724-ee9f4e66d5f9 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:26.001020 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec75c57-fe67-4c61-8724-ee9f4e66d5f9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:26.001314 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec75c57-fe67-4c61-8724-ee9f4e66d5f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:26.002718 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec75c57-fe67-4c61-8724-ee9f4e66d5f9 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:26.007744 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 406/786] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 15:06:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:26.013271 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec75c57-fe67-4c61-8724-ee9f4e66d5f9 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:26.062115 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:26.088881 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbc02f-f2a1-4193-8012-1aef05344acb None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:26.113008 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec75c57-fe67-4c61-8724-ee9f4e66d5f9 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:26.119901 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:26.130820 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca505f6c-0107-4d60-9eba-c6f46109d6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:26.131699 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca505f6c-0107-4d60-9eba-c6f46109d6f6 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:26.132104 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca505f6c-0107-4d60-9eba-c6f46109d6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:26.132534 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca505f6c-0107-4d60-9eba-c6f46109d6f6 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:26.133477 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca505f6c-0107-4d60-9eba-c6f46109d6f6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:26.133964 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca505f6c-0107-4d60-9eba-c6f46109d6f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:26.136101 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca505f6c-0107-4d60-9eba-c6f46109d6f6 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:26.142541 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 381/787] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Sep 23 15:06:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:26.149527 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca505f6c-0107-4d60-9eba-c6f46109d6f6 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:26.150842 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d2077-95f4-4058-a30a-76b7150d43cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:26.151449 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d2077-95f4-4058-a30a-76b7150d43cc None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:26.151724 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d2077-95f4-4058-a30a-76b7150d43cc None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:26.151991 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d2077-95f4-4058-a30a-76b7150d43cc None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:26.152610 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d2077-95f4-4058-a30a-76b7150d43cc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:26.153011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d2077-95f4-4058-a30a-76b7150d43cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:26.154305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d2077-95f4-4058-a30a-76b7150d43cc None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:26.160865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 407/788] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 15:06:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:26.166508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d2077-95f4-4058-a30a-76b7150d43cc None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:26.256709 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca505f6c-0107-4d60-9eba-c6f46109d6f6 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:26.265158 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d2077-95f4-4058-a30a-76b7150d43cc None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:26.278681 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:26.290447 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c31468-6bb1-40c7-9316-812ba737523c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:26.291060 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c31468-6bb1-40c7-9316-812ba737523c None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:26.291330 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c31468-6bb1-40c7-9316-812ba737523c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:26.291595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c31468-6bb1-40c7-9316-812ba737523c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:26.292256 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c31468-6bb1-40c7-9316-812ba737523c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:26.293600 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c31468-6bb1-40c7-9316-812ba737523c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:26.299025 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577b8b4-b1d6-4000-be9f-a5b7239a13db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:26.299624 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577b8b4-b1d6-4000-be9f-a5b7239a13db None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:26.299899 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577b8b4-b1d6-4000-be9f-a5b7239a13db None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:26.300166 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577b8b4-b1d6-4000-be9f-a5b7239a13db None admin] PATH_INFO: `/v3/endpoints` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:26.300813 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577b8b4-b1d6-4000-be9f-a5b7239a13db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:26.302181 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577b8b4-b1d6-4000-be9f-a5b7239a13db None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:26.313582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 382/789] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 15:06:26 2022] POST /identity/v3/endpoints => generated 347 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:06:26.321978 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 408/790] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 15:06:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:06:28.715171 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7afda-0d71-4bd3-bfb6-d7554f6f246b None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:28.715771 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7afda-0d71-4bd3-bfb6-d7554f6f246b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:28.715771 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7afda-0d71-4bd3-bfb6-d7554f6f246b None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:28.718976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 383/791] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:28.722419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f76ad-82e4-4dc3-ae55-fcfaf8ffbf05 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:28.722862 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f76ad-82e4-4dc3-ae55-fcfaf8ffbf05 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:28.722968 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f76ad-82e4-4dc3-ae55-fcfaf8ffbf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:28.733551 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92691af9-242a-4931-8e44-785365e5155a None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:28.733869 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92691af9-242a-4931-8e44-785365e5155a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:28.734140 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92691af9-242a-4931-8e44-785365e5155a None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:28.735488 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 384/792] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:28.740582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ae82f-73a8-4510-84bd-992168a5d0f3 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:28.740860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ae82f-73a8-4510-84bd-992168a5d0f3 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:28.741099 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ae82f-73a8-4510-84bd-992168a5d0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:28.741915 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-4c7f76ad-82e4-4dc3-ae55-fcfaf8ffbf05 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:28.743097 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-4c7f76ad-82e4-4dc3-ae55-fcfaf8ffbf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:28.759872 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-5d1ae82f-73a8-4510-84bd-992168a5d0f3 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:28.761030 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-5d1ae82f-73a8-4510-84bd-992168a5d0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:28.804726 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:28.815931 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 409/793] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:28 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:06:28.828416 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 385/794] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:28 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:06:29.130842 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f76ad-82e4-4dc3-ae55-fcfaf8ffbf05 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:29.147243 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ae82f-73a8-4510-84bd-992168a5d0f3 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:29.220946 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:29.227805 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f76ad-82e4-4dc3-ae55-fcfaf8ffbf05 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:29.249999 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ae82f-73a8-4510-84bd-992168a5d0f3 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:29.264061 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9b28e-4846-481c-a679-f7deafd5fb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:29.264695 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9b28e-4846-481c-a679-f7deafd5fb4b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:29.264974 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9b28e-4846-481c-a679-f7deafd5fb4b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:29.265244 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9b28e-4846-481c-a679-f7deafd5fb4b None admin] PATH_INFO: `/v3/services/compute` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:29.265858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9b28e-4846-481c-a679-f7deafd5fb4b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:29.267244 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9b28e-4846-481c-a679-f7deafd5fb4b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:29.275950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-d1a9b28e-4846-481c-a679-f7deafd5fb4b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 15:06:29.275950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:29.275950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:06:29.275950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:06:29.275950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:06:29.275950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:06:29.275950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:06:29.275950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:29.275950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 15:06:29.275950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:29.275950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:06:29.275950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:29.275950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:29.275950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:29.275950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:29.275950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:29.275950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:29.277011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:29.277011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:29.277011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:29.277011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:29.277011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:29.277011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:29.277011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:06:29.277011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:06:29.277011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:06:29.277011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:06:29.277011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:29.277011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:29.277011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:29.277011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:29.277011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:29.277011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:29.278641 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:29.278641 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:29.278641 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:29.278641 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:29.278641 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:29.278641 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:29.278641 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:29.278641 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:29.278641 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:29.278641 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:29.278641 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:06:29.278641 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:29.278641 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 15:06:29.278641 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:29.278641 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 410/795] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:06:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:29.282918 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9b28e-4846-481c-a679-f7deafd5fb4b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:29.287449 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab7130-ca16-45f4-9486-520691d7a1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:29.288217 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab7130-ca16-45f4-9486-520691d7a1ec None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:29.288493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab7130-ca16-45f4-9486-520691d7a1ec None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:29.288760 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab7130-ca16-45f4-9486-520691d7a1ec None admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:29.289403 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab7130-ca16-45f4-9486-520691d7a1ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:29.290882 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab7130-ca16-45f4-9486-520691d7a1ec None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:29.294303 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: WARNING keystone.server.flask.common [None req-dfab7130-ca16-45f4-9486-520691d7a1ec None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 23 15:06:29.312439 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.sql.core [None req-dfab7130-ca16-45f4-9486-520691d7a1ec None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 23 15:06:29.312439 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 23 15:06:29.312439 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [parameters: {'id': '2ed2f8d3446e4df1be23b11cdba1bf03', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 23 15:06:29.312439 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88306) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 23 15:06:29.329192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-dfab7130-ca16-45f4-9486-520691d7a1ec None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2ed2f8d3446e4df1be23b11cdba1bf03.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2ed2f8d3446e4df1be23b11cdba1bf03. Sep 23 15:06:29.329192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:29.329192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 15:06:29.329192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 15:06:29.329192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 15:06:29.329192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 15:06:29.329192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 15:06:29.329192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 15:06:29.329192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 15:06:29.329192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application conn.query(q) Sep 23 15:06:29.329192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 15:06:29.329192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 15:06:29.329192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 15:06:29.330164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application result.read() Sep 23 15:06:29.330164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 15:06:29.330164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 15:06:29.330164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 15:06:29.330164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 15:06:29.330164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 15:06:29.330164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 15:06:29.330164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 15:06:29.330164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 15:06:29.330164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 23 15:06:29.330164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:29.330164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 23 15:06:29.330164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:29.330164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:29.330164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 23 15:06:29.330164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 23 15:06:29.330164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 23 15:06:29.330164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 23 15:06:29.331172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 15:06:29.331172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application next(self.gen) Sep 23 15:06:29.331172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 23 15:06:29.331172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application yield resource Sep 23 15:06:29.331172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 15:06:29.331172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application next(self.gen) Sep 23 15:06:29.331172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 23 15:06:29.331172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self.session.rollback() Sep 23 15:06:29.331172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 15:06:29.331172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self.force_reraise() Sep 23 15:06:29.331172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 15:06:29.331172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise self.value Sep 23 15:06:29.331172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 23 15:06:29.331172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 23 15:06:29.331172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 23 15:06:29.331172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application session.commit() Sep 23 15:06:29.331172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 23 15:06:29.332145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 23 15:06:29.332145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 23 15:06:29.332145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._prepare_impl() Sep 23 15:06:29.332145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 23 15:06:29.332145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self.session.flush() Sep 23 15:06:29.332145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 23 15:06:29.332145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._flush(objects) Sep 23 15:06:29.332145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 23 15:06:29.332145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 23 15:06:29.332145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 23 15:06:29.332145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application compat.raise_( Sep 23 15:06:29.332145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 15:06:29.332145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception Sep 23 15:06:29.332145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 23 15:06:29.332145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application flush_context.execute() Sep 23 15:06:29.332145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 23 15:06:29.332145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rec.execute(self) Sep 23 15:06:29.333097 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 23 15:06:29.333097 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 23 15:06:29.333097 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 23 15:06:29.333097 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 23 15:06:29.333097 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 23 15:06:29.333097 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 23 15:06:29.333097 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 23 15:06:29.333097 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 23 15:06:29.333097 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 23 15:06:29.333097 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 23 15:06:29.333097 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 23 15:06:29.333097 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 23 15:06:29.333097 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 23 15:06:29.333097 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 23 15:06:29.333097 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 23 15:06:29.333952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 23 15:06:29.333952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 15:06:29.333952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception Sep 23 15:06:29.333952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 15:06:29.333952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 15:06:29.333952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 15:06:29.333952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 15:06:29.333952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 15:06:29.333952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 15:06:29.333952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 15:06:29.333952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application conn.query(q) Sep 23 15:06:29.333952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 15:06:29.333952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 15:06:29.333952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 15:06:29.333952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application result.read() Sep 23 15:06:29.333952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 15:06:29.333952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 15:06:29.334849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 15:06:29.334849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 15:06:29.334849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 15:06:29.334849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 15:06:29.334849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 15:06:29.334849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 15:06:29.334849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 23 15:06:29.334849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 23 15:06:29.334849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [parameters: {'id': '2ed2f8d3446e4df1be23b11cdba1bf03', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 23 15:06:29.334849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 23 15:06:29.334849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:29.334849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:06:29.334849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:29.334849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:29.334849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 23 15:06:29.335749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 23 15:06:29.335749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 23 15:06:29.335749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 23 15:06:29.335749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 23 15:06:29.335749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:29.335749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:06:29.335749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:29.335749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:29.335749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:29.335749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:29.335749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:29.335749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:29.335749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:29.335749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:29.335749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:29.335749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:29.335749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:29.336670 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:29.336670 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 23 15:06:29.336670 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 23 15:06:29.336670 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:29.336670 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:29.336670 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 23 15:06:29.336670 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 23 15:06:29.336670 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2ed2f8d3446e4df1be23b11cdba1bf03. Sep 23 15:06:29.336670 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:29.336670 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 386/796] 10.222.0.48 () {60 vars in 1140 bytes} [Fri Sep 23 15:06:29 2022] POST /identity/v3/projects => generated 262 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:29.336670 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab7130-ca16-45f4-9486-520691d7a1ec None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:29.371988 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:29.384821 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9b28e-4846-481c-a679-f7deafd5fb4b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:29.418708 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165ad7b-293f-46f0-b1d2-f725c14bbdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:29.419298 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165ad7b-293f-46f0-b1d2-f725c14bbdd6 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:29.419566 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165ad7b-293f-46f0-b1d2-f725c14bbdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:29.419825 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165ad7b-293f-46f0-b1d2-f725c14bbdd6 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:29.420437 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165ad7b-293f-46f0-b1d2-f725c14bbdd6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:29.420726 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165ad7b-293f-46f0-b1d2-f725c14bbdd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:29.422117 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165ad7b-293f-46f0-b1d2-f725c14bbdd6 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:29.426534 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 411/797] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 15:06:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:29.432331 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165ad7b-293f-46f0-b1d2-f725c14bbdd6 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:29.443313 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab7130-ca16-45f4-9486-520691d7a1ec None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:29.456452 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:29.478994 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c8d19-4706-4961-8023-c89fb0539730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:29.479636 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c8d19-4706-4961-8023-c89fb0539730 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:29.479915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c8d19-4706-4961-8023-c89fb0539730 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:29.480186 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c8d19-4706-4961-8023-c89fb0539730 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:29.487718 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c8d19-4706-4961-8023-c89fb0539730 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:29.489412 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c8d19-4706-4961-8023-c89fb0539730 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:29.500935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-aa1c8d19-4706-4961-8023-c89fb0539730 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:06:29.500935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:29.500935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:29.500935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:29.500935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:29.500935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:29.500935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:29.500935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:29.500935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:29.500935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:29.500935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:29.500935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:29.500935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:06:29.500935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:06:29.500935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:06:29.501860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:06:29.501860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:29.501860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:29.501860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:29.501860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:29.501860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:29.501860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:29.501860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:29.501860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:29.501860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:29.501860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:29.501860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:29.501860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:29.501860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:29.501860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:29.501860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:29.501860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:29.502912 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:06:29.502912 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:06:29.502912 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:06:29.502912 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:06:29.502912 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:06:29.502912 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:06:29.502912 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:06:29.502912 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:29.502912 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 387/798] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:06:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:06:29.508513 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c8d19-4706-4961-8023-c89fb0539730 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:29.529194 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165ad7b-293f-46f0-b1d2-f725c14bbdd6 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:29.561115 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d9f63-db58-4f49-add6-541a3e4c1bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:29.561736 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d9f63-db58-4f49-add6-541a3e4c1bbe None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:29.562012 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d9f63-db58-4f49-add6-541a3e4c1bbe None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:29.562275 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d9f63-db58-4f49-add6-541a3e4c1bbe None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:29.562891 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d9f63-db58-4f49-add6-541a3e4c1bbe None admin] RBAC: Adding query filter params (type=compute) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:29.563185 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d9f63-db58-4f49-add6-541a3e4c1bbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:29.564549 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d9f63-db58-4f49-add6-541a3e4c1bbe None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:29.568931 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 412/799] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 15:06:29 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:29.604902 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:29.612801 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c8d19-4706-4961-8023-c89fb0539730 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:29.649484 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff347e6-53d6-4b8b-bda7-94869613320c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:29.650056 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff347e6-53d6-4b8b-bda7-94869613320c None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:29.650334 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff347e6-53d6-4b8b-bda7-94869613320c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:29.650609 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff347e6-53d6-4b8b-bda7-94869613320c None admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:29.651273 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff347e6-53d6-4b8b-bda7-94869613320c None admin] RBAC: Adding query filter params (name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:29.651578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff347e6-53d6-4b8b-bda7-94869613320c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:29.653027 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff347e6-53d6-4b8b-bda7-94869613320c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:29.674747 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 388/800] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 15:06:29 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:06:31.946709 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cacbc5-1da2-40f3-bc54-42914fc34701 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:31.947238 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cacbc5-1da2-40f3-bc54-42914fc34701 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:31.947238 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cacbc5-1da2-40f3-bc54-42914fc34701 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:31.948570 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 413/801] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:31.954053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61598e5-aa8a-46a3-9338-f4630e61cbb2 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:31.954490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61598e5-aa8a-46a3-9338-f4630e61cbb2 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:31.954580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61598e5-aa8a-46a3-9338-f4630e61cbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:31.973855 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-a61598e5-aa8a-46a3-9338-f4630e61cbb2 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:31.975287 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-a61598e5-aa8a-46a3-9338-f4630e61cbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:32.046641 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 389/802] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:31 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:06:32.129021 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9b12b-ccf4-4965-a25b-8ded3643f14d None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:32.129269 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9b12b-ccf4-4965-a25b-8ded3643f14d None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:32.129569 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9b12b-ccf4-4965-a25b-8ded3643f14d None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:32.130919 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 414/803] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:32.136351 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75802b1b-ac25-469f-bc68-33dd869247ab None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:32.136641 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75802b1b-ac25-469f-bc68-33dd869247ab None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:32.136916 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75802b1b-ac25-469f-bc68-33dd869247ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:32.156523 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-75802b1b-ac25-469f-bc68-33dd869247ab None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:32.157724 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-75802b1b-ac25-469f-bc68-33dd869247ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:32.226591 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 390/804] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:32 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:06:32.363633 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9b12b-ccf4-4965-a25b-8ded3643f14d None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:32.452877 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:32.466964 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9b12b-ccf4-4965-a25b-8ded3643f14d None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:32.500129 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e3a0b-97c3-43c7-869a-a1727005ca61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:32.500666 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e3a0b-97c3-43c7-869a-a1727005ca61 None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:32.500940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e3a0b-97c3-43c7-869a-a1727005ca61 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:32.501203 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e3a0b-97c3-43c7-869a-a1727005ca61 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:32.501876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e3a0b-97c3-43c7-869a-a1727005ca61 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:32.503227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e3a0b-97c3-43c7-869a-a1727005ca61 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:32.517810 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 415/805] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 15:06:32 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:06:32.548653 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75802b1b-ac25-469f-bc68-33dd869247ab None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:32.564925 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:32.658328 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75802b1b-ac25-469f-bc68-33dd869247ab None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:32.702988 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77316fca-fb5f-41fc-bb63-8db14f71ab67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:32.703613 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77316fca-fb5f-41fc-bb63-8db14f71ab67 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:32.703886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77316fca-fb5f-41fc-bb63-8db14f71ab67 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:32.704158 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77316fca-fb5f-41fc-bb63-8db14f71ab67 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:32.704797 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77316fca-fb5f-41fc-bb63-8db14f71ab67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:32.706282 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77316fca-fb5f-41fc-bb63-8db14f71ab67 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:32.727971 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.sql.core [None req-77316fca-fb5f-41fc-bb63-8db14f71ab67 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 23 15:06:32.727971 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 23 15:06:32.727971 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [parameters: {'user_id': 'ef23ed7e0a7d45a6b06234eaac3a8331', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 23 15:06:32.727971 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88306) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 23 15:06:32.735479 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-77316fca-fb5f-41fc-bb63-8db14f71ab67 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 23 15:06:32.735479 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:32.735479 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 15:06:32.735479 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 15:06:32.735479 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 15:06:32.735479 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 15:06:32.735479 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 15:06:32.735479 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 15:06:32.735479 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 15:06:32.735479 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application conn.query(q) Sep 23 15:06:32.735479 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 15:06:32.735479 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 15:06:32.735479 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 15:06:32.735479 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application result.read() Sep 23 15:06:32.735479 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 15:06:32.736427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 15:06:32.736427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 15:06:32.736427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 15:06:32.736427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 15:06:32.736427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 15:06:32.736427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 15:06:32.736427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 15:06:32.736427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 23 15:06:32.736427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:32.736427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 23 15:06:32.736427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:32.736427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:32.736427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 23 15:06:32.736427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 23 15:06:32.736427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 23 15:06:32.736427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 23 15:06:32.736427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 15:06:32.736427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application next(self.gen) Sep 23 15:06:32.737836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 23 15:06:32.737836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application yield resource Sep 23 15:06:32.737836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 15:06:32.737836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application next(self.gen) Sep 23 15:06:32.737836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 23 15:06:32.737836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self.session.rollback() Sep 23 15:06:32.737836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 15:06:32.737836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self.force_reraise() Sep 23 15:06:32.737836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 15:06:32.737836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise self.value Sep 23 15:06:32.737836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 23 15:06:32.737836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 23 15:06:32.737836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 23 15:06:32.737836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application session.commit() Sep 23 15:06:32.737836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 23 15:06:32.737836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 23 15:06:32.737836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 23 15:06:32.738750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._prepare_impl() Sep 23 15:06:32.738750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 23 15:06:32.738750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self.session.flush() Sep 23 15:06:32.738750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 23 15:06:32.738750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._flush(objects) Sep 23 15:06:32.738750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 23 15:06:32.738750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 23 15:06:32.738750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 23 15:06:32.738750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application compat.raise_( Sep 23 15:06:32.738750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 15:06:32.738750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception Sep 23 15:06:32.738750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 23 15:06:32.738750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application flush_context.execute() Sep 23 15:06:32.738750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 23 15:06:32.738750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rec.execute(self) Sep 23 15:06:32.738750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 23 15:06:32.738750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 23 15:06:32.739662 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 23 15:06:32.739662 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 23 15:06:32.739662 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 23 15:06:32.739662 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 23 15:06:32.739662 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 23 15:06:32.739662 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 23 15:06:32.739662 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 23 15:06:32.739662 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 23 15:06:32.739662 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 23 15:06:32.739662 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 23 15:06:32.739662 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 23 15:06:32.739662 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 23 15:06:32.739662 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 23 15:06:32.739662 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 23 15:06:32.739662 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 15:06:32.739662 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception Sep 23 15:06:32.740685 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 15:06:32.740685 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 15:06:32.740685 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 15:06:32.740685 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 15:06:32.740685 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 15:06:32.740685 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 15:06:32.740685 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 15:06:32.740685 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application conn.query(q) Sep 23 15:06:32.740685 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 15:06:32.740685 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 15:06:32.740685 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 15:06:32.740685 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application result.read() Sep 23 15:06:32.740685 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 15:06:32.740685 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 15:06:32.740685 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 15:06:32.740685 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 15:06:32.742142 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 15:06:32.742142 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 15:06:32.742142 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 15:06:32.742142 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 15:06:32.742142 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 23 15:06:32.742142 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 23 15:06:32.742142 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ef23ed7e0a7d45a6b06234eaac3a8331', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 23 15:06:32.742142 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 23 15:06:32.742142 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:32.742142 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:06:32.742142 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:32.742142 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:32.742142 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:32.742142 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:32.742142 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:32.742963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:32.742963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:32.742963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:32.742963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:32.742963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:32.742963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:32.742963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:32.742963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 23 15:06:32.742963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 23 15:06:32.742963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:32.742963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:32.742963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:06:32.742963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:06:32.742963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:06:32.742963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:06:32.742963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 23 15:06:32.742963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 23 15:06:32.743910 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 23 15:06:32.743910 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 23 15:06:32.743910 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 23 15:06:32.743910 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 23 15:06:32.743910 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 23 15:06:32.743910 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:32.743910 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 391/806] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Sep 23 15:06:32 2022] POST /identity/v3/users => generated 160 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:32.744315 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e3a0b-97c3-43c7-869a-a1727005ca61 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:32.845376 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e3a0b-97c3-43c7-869a-a1727005ca61 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:32.879769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad2ac9-c6c8-41f6-b77b-074d38e86577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:32.880401 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad2ac9-c6c8-41f6-b77b-074d38e86577 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:32.880681 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad2ac9-c6c8-41f6-b77b-074d38e86577 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:32.880950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad2ac9-c6c8-41f6-b77b-074d38e86577 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:32.888607 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad2ac9-c6c8-41f6-b77b-074d38e86577 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:32.890078 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad2ac9-c6c8-41f6-b77b-074d38e86577 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:32.901415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-44ad2ac9-c6c8-41f6-b77b-074d38e86577 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 15:06:32.901415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:32.901415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:32.901415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:32.901415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:32.901415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:32.901415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:32.901415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:32.901415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:32.901415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:32.901415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:32.901415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:32.901415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:06:32.901415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:06:32.901415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:06:32.901415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:06:32.902581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:32.902581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:32.902581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:06:32.902581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:06:32.902581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:06:32.902581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:06:32.902581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:32.902581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:32.902581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:32.902581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:32.902581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:32.902581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:32.902581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:32.902581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:32.902581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:32.902581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:32.902581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:32.902581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:32.903673 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:32.903673 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:32.903673 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:06:32.903673 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:06:32.903673 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:06:32.903673 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:06:32.903673 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:06:32.903673 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:06:32.903673 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 15:06:32.903673 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:32.903673 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 416/807] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:06:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:32.908725 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77316fca-fb5f-41fc-bb63-8db14f71ab67 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:32.980581 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:33.012385 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77316fca-fb5f-41fc-bb63-8db14f71ab67 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:33.047490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ddb61-9cb1-4c42-888f-3d4416745caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:33.048108 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ddb61-9cb1-4c42-888f-3d4416745caa None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:33.048387 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ddb61-9cb1-4c42-888f-3d4416745caa None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:33.048659 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ddb61-9cb1-4c42-888f-3d4416745caa None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:33.049359 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ddb61-9cb1-4c42-888f-3d4416745caa None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:33.049660 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ddb61-9cb1-4c42-888f-3d4416745caa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:33.051332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ddb61-9cb1-4c42-888f-3d4416745caa None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:33.089248 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 392/808] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 15:06:32 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:34.898880 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9db5a5-a68e-4c8c-8763-d3e74d2d6a5f None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:34.899459 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9db5a5-a68e-4c8c-8763-d3e74d2d6a5f None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:34.899459 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9db5a5-a68e-4c8c-8763-d3e74d2d6a5f None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:34.900722 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 417/809] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:34.906333 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c48cf-ca6b-4877-9869-74404c803a8d None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:34.906749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c48cf-ca6b-4877-9869-74404c803a8d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:34.906861 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c48cf-ca6b-4877-9869-74404c803a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:34.925616 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-a01c48cf-ca6b-4877-9869-74404c803a8d None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:34.927151 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-a01c48cf-ca6b-4877-9869-74404c803a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:34.997777 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 393/810] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:34 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:06:35.314072 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9db5a5-a68e-4c8c-8763-d3e74d2d6a5f None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:35.332927 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:35.426908 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9db5a5-a68e-4c8c-8763-d3e74d2d6a5f None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:35.462586 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f047b2b-941f-4546-bef9-fc49a22df6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:35.463193 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f047b2b-941f-4546-bef9-fc49a22df6dc None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:35.463468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f047b2b-941f-4546-bef9-fc49a22df6dc None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:35.463736 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f047b2b-941f-4546-bef9-fc49a22df6dc None admin] PATH_INFO: `/v3/services/compute` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:35.464306 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f047b2b-941f-4546-bef9-fc49a22df6dc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:35.465649 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f047b2b-941f-4546-bef9-fc49a22df6dc None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:35.474996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-2f047b2b-941f-4546-bef9-fc49a22df6dc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 15:06:35.474996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:35.474996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:06:35.474996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:06:35.474996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:06:35.474996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:06:35.474996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:06:35.474996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:35.474996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 15:06:35.474996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:35.474996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:06:35.474996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:35.474996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:35.474996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:35.474996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:35.474996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:35.474996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:35.476189 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:35.476189 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:35.476189 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:35.476189 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:35.476189 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:35.476189 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:35.476189 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:06:35.476189 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:06:35.476189 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:06:35.476189 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:06:35.476189 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:35.476189 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:35.476189 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:35.476189 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:35.476189 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:35.476189 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:35.477308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:35.477308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:35.477308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:35.477308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:35.477308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:35.477308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:35.477308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:35.477308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:35.477308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:35.477308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:35.477308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:06:35.477308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:35.477308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 15:06:35.477308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:06:35.477308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 418/811] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:06:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:35.484697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c48cf-ca6b-4877-9869-74404c803a8d None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:35.553051 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:35.599082 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c48cf-ca6b-4877-9869-74404c803a8d None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:35.635660 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4444b9-fb26-41b2-b020-31d47bca4641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:35.636252 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4444b9-fb26-41b2-b020-31d47bca4641 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:35.636526 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4444b9-fb26-41b2-b020-31d47bca4641 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:35.636796 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4444b9-fb26-41b2-b020-31d47bca4641 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:35.637403 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4444b9-fb26-41b2-b020-31d47bca4641 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:35.637726 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4444b9-fb26-41b2-b020-31d47bca4641 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:35.639084 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4444b9-fb26-41b2-b020-31d47bca4641 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:35.644029 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 394/812] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 15:06:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:35.650628 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f047b2b-941f-4546-bef9-fc49a22df6dc None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:35.733426 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:35.764693 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f047b2b-941f-4546-bef9-fc49a22df6dc None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:35.807169 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c75e2d-a0ac-4b0e-975b-82ec8f261da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:35.807767 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c75e2d-a0ac-4b0e-975b-82ec8f261da0 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:35.808041 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c75e2d-a0ac-4b0e-975b-82ec8f261da0 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:35.808311 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c75e2d-a0ac-4b0e-975b-82ec8f261da0 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:35.808928 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c75e2d-a0ac-4b0e-975b-82ec8f261da0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:35.809222 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c75e2d-a0ac-4b0e-975b-82ec8f261da0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:35.810628 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c75e2d-a0ac-4b0e-975b-82ec8f261da0 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:35.815410 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 419/813] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 15:06:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:35.821595 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4444b9-fb26-41b2-b020-31d47bca4641 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:35.927935 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4444b9-fb26-41b2-b020-31d47bca4641 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:35.956397 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:35.970487 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230db9e-e7d4-4d4d-944d-ef2f79e55e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:35.971081 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230db9e-e7d4-4d4d-944d-ef2f79e55e0c None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:35.971351 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230db9e-e7d4-4d4d-944d-ef2f79e55e0c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:35.971620 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230db9e-e7d4-4d4d-944d-ef2f79e55e0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:35.972315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230db9e-e7d4-4d4d-944d-ef2f79e55e0c None admin] RBAC: Adding query filter params (interface=public, service_id=62d646a3bd1c4547923ec9e59202e27d, region_id=RegionOne) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:35.972617 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230db9e-e7d4-4d4d-944d-ef2f79e55e0c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:35.973992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230db9e-e7d4-4d4d-944d-ef2f79e55e0c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:35.979600 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 395/814] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Sep 23 15:06:35 2022] GET /identity/v3/endpoints?service_id=62d646a3bd1c4547923ec9e59202e27d&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:35.989526 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c75e2d-a0ac-4b0e-975b-82ec8f261da0 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:36.107725 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c75e2d-a0ac-4b0e-975b-82ec8f261da0 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:36.143765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32b9bc-ccf4-4fa0-a40a-183f226fa263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:36.144360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32b9bc-ccf4-4fa0-a40a-183f226fa263 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:36.144635 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32b9bc-ccf4-4fa0-a40a-183f226fa263 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:36.144907 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32b9bc-ccf4-4fa0-a40a-183f226fa263 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:36.145496 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32b9bc-ccf4-4fa0-a40a-183f226fa263 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:36.146901 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32b9bc-ccf4-4fa0-a40a-183f226fa263 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:36.148628 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:36.153653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 420/815] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Sep 23 15:06:35 2022] GET /identity/v3/services => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:06:38.520124 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c06d0-a0f4-47fb-b258-3ec6b202be69 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:38.520987 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c06d0-a0f4-47fb-b258-3ec6b202be69 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:38.520987 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c06d0-a0f4-47fb-b258-3ec6b202be69 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:38.523114 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 396/816] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:06:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:06:38.528524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7fd47-be7f-43c1-8f15-9f41b6a41a9a None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:38.528942 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7fd47-be7f-43c1-8f15-9f41b6a41a9a None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:38.529030 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7fd47-be7f-43c1-8f15-9f41b6a41a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:38.549206 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-34d7fd47-be7f-43c1-8f15-9f41b6a41a9a None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:06:38.550385 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-34d7fd47-be7f-43c1-8f15-9f41b6a41a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:06:38.617485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 421/817] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:06:38 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:06:38.947230 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c06d0-a0f4-47fb-b258-3ec6b202be69 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:39.073093 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c06d0-a0f4-47fb-b258-3ec6b202be69 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:39.109623 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060e120-eb6e-412a-ab2f-1c34bef517bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:39.110271 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060e120-eb6e-412a-ab2f-1c34bef517bf None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:39.110544 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060e120-eb6e-412a-ab2f-1c34bef517bf None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:39.110813 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060e120-eb6e-412a-ab2f-1c34bef517bf None admin] PATH_INFO: `/v3/services/compute` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:39.111391 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060e120-eb6e-412a-ab2f-1c34bef517bf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:39.112748 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060e120-eb6e-412a-ab2f-1c34bef517bf None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:39.122091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-9060e120-eb6e-412a-ab2f-1c34bef517bf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 15:06:39.122091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:39.122091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:06:39.122091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:06:39.122091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:06:39.122091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:06:39.122091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:06:39.122091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:39.122091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 15:06:39.122091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:39.122091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:06:39.122091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:39.122091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:06:39.122091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:06:39.122091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:06:39.122091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:06:39.122091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:06:39.123235 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:06:39.123235 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:06:39.123235 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:06:39.123235 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:06:39.123235 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:06:39.123235 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:06:39.123235 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:06:39.123235 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:06:39.123235 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:06:39.123235 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:06:39.123235 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:06:39.123235 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:06:39.123235 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:06:39.123235 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:06:39.123235 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:06:39.123235 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:06:39.124221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:06:39.124221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:06:39.124221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:06:39.124221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:06:39.124221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:06:39.124221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:06:39.124221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:06:39.124221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:06:39.124221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:06:39.124221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:06:39.124221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:06:39.124221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:06:39.124221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 15:06:39.124221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:06:39.124221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 397/818] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:06:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:06:39.130199 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7fd47-be7f-43c1-8f15-9f41b6a41a9a None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:39.233213 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7fd47-be7f-43c1-8f15-9f41b6a41a9a None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:39.267676 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:39.275247 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8e3bf-ec98-4591-b756-77f69effeada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:39.275839 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8e3bf-ec98-4591-b756-77f69effeada None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:39.276095 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8e3bf-ec98-4591-b756-77f69effeada None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:39.276357 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8e3bf-ec98-4591-b756-77f69effeada None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:39.276971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8e3bf-ec98-4591-b756-77f69effeada None admin] RBAC: Adding query filter params (name=compute) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:39.277260 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8e3bf-ec98-4591-b756-77f69effeada None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:39.278649 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8e3bf-ec98-4591-b756-77f69effeada None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:39.283580 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 422/819] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 15:06:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:39.289458 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060e120-eb6e-412a-ab2f-1c34bef517bf None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:39.346855 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:39.408597 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060e120-eb6e-412a-ab2f-1c34bef517bf None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:39.443748 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c192b-9350-4a3f-aaa2-da57370b44dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:39.444348 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c192b-9350-4a3f-aaa2-da57370b44dc None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:39.444624 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c192b-9350-4a3f-aaa2-da57370b44dc None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:39.444941 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c192b-9350-4a3f-aaa2-da57370b44dc None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:39.445561 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c192b-9350-4a3f-aaa2-da57370b44dc None admin] RBAC: Adding query filter params (type=compute) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:06:39.445890 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c192b-9350-4a3f-aaa2-da57370b44dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:39.447260 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c192b-9350-4a3f-aaa2-da57370b44dc None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:39.452267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 398/820] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 15:06:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:06:39.458886 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8e3bf-ec98-4591-b756-77f69effeada None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:06:39.567729 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8e3bf-ec98-4591-b756-77f69effeada None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:06:39.607491 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f2f68-4abc-44ec-a357-66404984b482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:06:39.608077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f2f68-4abc-44ec-a357-66404984b482 None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:06:39.608348 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f2f68-4abc-44ec-a357-66404984b482 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:06:39.608615 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f2f68-4abc-44ec-a357-66404984b482 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:06:39.609260 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f2f68-4abc-44ec-a357-66404984b482 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:06:39.610635 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f2f68-4abc-44ec-a357-66404984b482 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:06:39.636980 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 423/821] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 15:06:39 2022] POST /identity/v3/endpoints => generated 334 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:06:49.449561 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=42 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:06:49.629606 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=74,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:42.522899 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee18e0-d8aa-495e-b99c-84745e70faa1 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:42.523487 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee18e0-d8aa-495e-b99c-84745e70faa1 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:42.523487 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee18e0-d8aa-495e-b99c-84745e70faa1 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:42.525104 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 399/822] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:07:42.530551 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170f9b4-ded4-49bd-bfb0-240bf14983e3 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:42.531021 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170f9b4-ded4-49bd-bfb0-240bf14983e3 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:42.531128 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170f9b4-ded4-49bd-bfb0-240bf14983e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:42.552251 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-3170f9b4-ded4-49bd-bfb0-240bf14983e3 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:07:42.553543 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-3170f9b4-ded4-49bd-bfb0-240bf14983e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:07:42.639522 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 424/823] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:07:42 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:07:42.983280 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee18e0-d8aa-495e-b99c-84745e70faa1 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:43.111915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee18e0-d8aa-495e-b99c-84745e70faa1 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:43.153677 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57257753-d77b-4b65-8e92-8bc33e02fd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:43.154363 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57257753-d77b-4b65-8e92-8bc33e02fd5d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:43.154634 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57257753-d77b-4b65-8e92-8bc33e02fd5d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:43.154904 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57257753-d77b-4b65-8e92-8bc33e02fd5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:43.168431 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57257753-d77b-4b65-8e92-8bc33e02fd5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:43.169965 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57257753-d77b-4b65-8e92-8bc33e02fd5d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:43.186786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-57257753-d77b-4b65-8e92-8bc33e02fd5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:07:43.186786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:07:43.186786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:07:43.186786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:07:43.186786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:07:43.186786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:07:43.186786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:07:43.186786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:07:43.186786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:07:43.186786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:07:43.186786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:07:43.186786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:07:43.186786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:07:43.186786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:07:43.186786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:07:43.186786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:07:43.188429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:07:43.188429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:07:43.188429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:07:43.188429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:07:43.188429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:07:43.188429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:07:43.188429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:07:43.188429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:07:43.188429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:07:43.188429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:07:43.188429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:07:43.188429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:07:43.188429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:07:43.188429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:07:43.188429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:07:43.188429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:07:43.188429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:07:43.189452 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:07:43.189452 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:07:43.189452 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:07:43.189452 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 400/824] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:07:43.194594 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170f9b4-ded4-49bd-bfb0-240bf14983e3 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:43.316182 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170f9b4-ded4-49bd-bfb0-240bf14983e3 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:43.349902 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:43.361859 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288a53a-4e98-4df8-af64-d675f03e6524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:43.362798 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288a53a-4e98-4df8-af64-d675f03e6524 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:43.363116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288a53a-4e98-4df8-af64-d675f03e6524 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:43.363396 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288a53a-4e98-4df8-af64-d675f03e6524 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:43.364224 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288a53a-4e98-4df8-af64-d675f03e6524 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:07:43.364628 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288a53a-4e98-4df8-af64-d675f03e6524 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:43.366274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288a53a-4e98-4df8-af64-d675f03e6524 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:43.382325 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 425/825] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:07:43.389955 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57257753-d77b-4b65-8e92-8bc33e02fd5d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:43.460960 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:43.512893 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57257753-d77b-4b65-8e92-8bc33e02fd5d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:43.546625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb688152-c62e-4889-9630-64adde10d002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:43.547348 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb688152-c62e-4889-9630-64adde10d002 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:43.547517 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb688152-c62e-4889-9630-64adde10d002 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:43.547723 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb688152-c62e-4889-9630-64adde10d002 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:43.548376 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb688152-c62e-4889-9630-64adde10d002 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:43.549874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb688152-c62e-4889-9630-64adde10d002 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:43.571916 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 401/826] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 15:07:43 2022] POST /identity/v3/users => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:07:46.255211 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397952d-7e08-4ef1-954e-72bbf95bd264 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:46.255805 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397952d-7e08-4ef1-954e-72bbf95bd264 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:46.255805 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397952d-7e08-4ef1-954e-72bbf95bd264 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:46.257241 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 426/827] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:07:46.262704 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d7b6c-9f35-4c03-a008-6b3c1f5d83bf None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:46.263161 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d7b6c-9f35-4c03-a008-6b3c1f5d83bf None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:46.263321 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d7b6c-9f35-4c03-a008-6b3c1f5d83bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:46.282846 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-9e2d7b6c-9f35-4c03-a008-6b3c1f5d83bf None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:07:46.284043 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-9e2d7b6c-9f35-4c03-a008-6b3c1f5d83bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:07:46.355968 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 402/828] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:07:46 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:07:46.692176 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397952d-7e08-4ef1-954e-72bbf95bd264 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:46.802012 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397952d-7e08-4ef1-954e-72bbf95bd264 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:46.842799 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b19c3b-24f0-4f6d-aae1-307c7b363927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:46.843566 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b19c3b-24f0-4f6d-aae1-307c7b363927 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:46.843864 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b19c3b-24f0-4f6d-aae1-307c7b363927 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:46.844257 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b19c3b-24f0-4f6d-aae1-307c7b363927 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:46.858163 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b19c3b-24f0-4f6d-aae1-307c7b363927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:07:46.863520 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-f9b19c3b-24f0-4f6d-aae1-307c7b363927 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:07:46.863520 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:07:46.863520 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:07:46.863520 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:07:46.863520 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:07:46.863520 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:07:46.863520 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:07:46.863520 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:07:46.863520 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:07:46.863520 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:07:46.863520 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:07:46.863520 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:07:46.863520 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:07:46.863520 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:07:46.863520 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:07:46.863520 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:07:46.864675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:07:46.864675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:07:46.864675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:07:46.864675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:07:46.864675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:07:46.864675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:07:46.864675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:07:46.864675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:07:46.864675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:07:46.864675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:07:46.864675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:07:46.864675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:07:46.864675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:07:46.864675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:07:46.864675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:07:46.864675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:07:46.866243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:07:46.866243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:07:46.866243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:07:46.866243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:07:46.866243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:07:46.866243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:07:46.866243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:07:46.866243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:07:46.866243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:07:46.866243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:07:46.866243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:07:46.866243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:07:46.866243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 427/829] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 15:07:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:07:46.870832 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d7b6c-9f35-4c03-a008-6b3c1f5d83bf None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:46.914708 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:46.983829 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d7b6c-9f35-4c03-a008-6b3c1f5d83bf None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:47.022860 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68644f-8851-495f-b883-fa11339aa569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:47.023575 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68644f-8851-495f-b883-fa11339aa569 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:47.023874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68644f-8851-495f-b883-fa11339aa569 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:47.024147 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68644f-8851-495f-b883-fa11339aa569 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:47.024837 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68644f-8851-495f-b883-fa11339aa569 None admin] RBAC: Adding query filter params (name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:07:47.025198 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68644f-8851-495f-b883-fa11339aa569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:47.026864 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68644f-8851-495f-b883-fa11339aa569 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:47.035613 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 403/830] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 15:07:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:07:47.041553 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b19c3b-24f0-4f6d-aae1-307c7b363927 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:47.089227 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:47.146190 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b19c3b-24f0-4f6d-aae1-307c7b363927 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:47.179146 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44452359-c713-4856-9462-7dd67b8eda50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:47.179769 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44452359-c713-4856-9462-7dd67b8eda50 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:47.180045 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44452359-c713-4856-9462-7dd67b8eda50 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:47.180312 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44452359-c713-4856-9462-7dd67b8eda50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:47.190600 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44452359-c713-4856-9462-7dd67b8eda50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:47.192068 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44452359-c713-4856-9462-7dd67b8eda50 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:47.205657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-44452359-c713-4856-9462-7dd67b8eda50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:07:47.205657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:07:47.205657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:07:47.205657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:07:47.205657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:07:47.205657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:07:47.205657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:07:47.205657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:07:47.205657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:07:47.205657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:07:47.205657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:07:47.205657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:07:47.205657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:07:47.205657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:07:47.205657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:07:47.205657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:07:47.206780 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:07:47.206780 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:07:47.206780 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:07:47.206780 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:07:47.206780 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:07:47.206780 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:07:47.206780 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:07:47.206780 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:07:47.206780 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:07:47.206780 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:07:47.206780 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:07:47.206780 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:07:47.206780 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:07:47.206780 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:07:47.206780 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:07:47.206780 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:07:47.206780 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:07:47.207747 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:07:47.207747 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:07:47.207747 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:07:47.211846 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 428/831] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:07:47.212993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68644f-8851-495f-b883-fa11339aa569 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:47.319995 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:47.324061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68644f-8851-495f-b883-fa11339aa569 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:47.365219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8142d86-8cd8-4e02-b4ea-5ad781ae20b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:47.365925 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8142d86-8cd8-4e02-b4ea-5ad781ae20b6 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:47.366236 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8142d86-8cd8-4e02-b4ea-5ad781ae20b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:47.366537 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8142d86-8cd8-4e02-b4ea-5ad781ae20b6 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:47.367222 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8142d86-8cd8-4e02-b4ea-5ad781ae20b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:07:47.367543 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8142d86-8cd8-4e02-b4ea-5ad781ae20b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:47.368982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8142d86-8cd8-4e02-b4ea-5ad781ae20b6 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:47.382882 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 404/832] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:07:47.388587 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44452359-c713-4856-9462-7dd67b8eda50 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:47.496459 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:47.500904 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44452359-c713-4856-9462-7dd67b8eda50 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:47.540143 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e58152-e922-4d39-b24c-b8ee168f4f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:47.540863 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e58152-e922-4d39-b24c-b8ee168f4f7b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:47.541146 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e58152-e922-4d39-b24c-b8ee168f4f7b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:47.541447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e58152-e922-4d39-b24c-b8ee168f4f7b None admin] PATH_INFO: `/v3/users/placement` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:47.550095 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e58152-e922-4d39-b24c-b8ee168f4f7b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:47.551742 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e58152-e922-4d39-b24c-b8ee168f4f7b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:47.563644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-f9e58152-e922-4d39-b24c-b8ee168f4f7b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:07:47.563644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:07:47.563644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:07:47.563644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:07:47.563644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:07:47.563644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:07:47.563644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:07:47.563644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:07:47.563644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:07:47.563644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:07:47.563644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:07:47.563644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:07:47.563644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:07:47.563644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:07:47.563644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:07:47.563644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:07:47.564687 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:07:47.564687 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:07:47.564687 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:07:47.564687 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:07:47.564687 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:07:47.564687 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:07:47.564687 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:07:47.564687 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:07:47.564687 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:07:47.564687 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:07:47.564687 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:07:47.564687 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:07:47.564687 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:07:47.564687 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:07:47.564687 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:07:47.564687 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:07:47.564687 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:07:47.564687 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:07:47.565657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:07:47.565657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:07:47.565657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:07:47.565657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:07:47.565657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:07:47.565657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:07:47.565657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:07:47.565657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:07:47.565657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:07:47.565657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:07:47.565657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 429/833] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:07:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:07:47.570833 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8142d86-8cd8-4e02-b4ea-5ad781ae20b6 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:47.679339 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8142d86-8cd8-4e02-b4ea-5ad781ae20b6 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:47.718408 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd8b2f-1fda-46bf-9cd3-208011a90061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:47.719112 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd8b2f-1fda-46bf-9cd3-208011a90061 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:47.719392 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd8b2f-1fda-46bf-9cd3-208011a90061 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:47.719665 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd8b2f-1fda-46bf-9cd3-208011a90061 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:47.721781 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd8b2f-1fda-46bf-9cd3-208011a90061 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:07:47.722152 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd8b2f-1fda-46bf-9cd3-208011a90061 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:47.723586 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd8b2f-1fda-46bf-9cd3-208011a90061 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:47.743347 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 405/834] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Sep 23 15:07:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:07:47.749495 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e58152-e922-4d39-b24c-b8ee168f4f7b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:47.859151 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e58152-e922-4d39-b24c-b8ee168f4f7b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:47.904036 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0d1d6-c19d-4131-b49e-e238b77f3e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:47.904921 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0d1d6-c19d-4131-b49e-e238b77f3e65 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:47.905378 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0d1d6-c19d-4131-b49e-e238b77f3e65 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:47.905739 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0d1d6-c19d-4131-b49e-e238b77f3e65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:47.945509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:47.989180 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0d1d6-c19d-4131-b49e-e238b77f3e65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:47.990938 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0d1d6-c19d-4131-b49e-e238b77f3e65 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:48.096459 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 430/835] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:07:47 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:07:48.102226 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd8b2f-1fda-46bf-9cd3-208011a90061 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:48.121786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:48.215900 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd8b2f-1fda-46bf-9cd3-208011a90061 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:48.252049 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35628a-fe8d-4e20-b824-5a3253c16c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:48.252691 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35628a-fe8d-4e20-b824-5a3253c16c6a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:48.252954 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35628a-fe8d-4e20-b824-5a3253c16c6a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:48.253224 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35628a-fe8d-4e20-b824-5a3253c16c6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:48.263299 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e35628a-fe8d-4e20-b824-5a3253c16c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:48.264748 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e35628a-fe8d-4e20-b824-5a3253c16c6a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:48.279992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-9e35628a-fe8d-4e20-b824-5a3253c16c6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:07:48.279992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:07:48.279992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:07:48.279992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:07:48.279992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:07:48.279992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:07:48.279992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:07:48.279992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:07:48.279992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:07:48.279992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:07:48.279992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:07:48.279992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:07:48.279992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:07:48.279992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:07:48.279992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:07:48.279992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:07:48.281170 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:07:48.281170 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:07:48.281170 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:07:48.281170 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:07:48.281170 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:07:48.281170 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:07:48.281170 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:07:48.281170 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:07:48.281170 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:07:48.281170 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:07:48.281170 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:07:48.281170 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:07:48.281170 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:07:48.281170 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:07:48.281170 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:07:48.281170 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:07:48.281170 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:07:48.282279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:07:48.282279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:07:48.282279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:07:48.282279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 406/836] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:07:48.287222 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0d1d6-c19d-4131-b49e-e238b77f3e65 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:48.350424 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:48.400134 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0d1d6-c19d-4131-b49e-e238b77f3e65 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:48.446200 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb5166-217a-4079-9e3f-591639090733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:48.446828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb5166-217a-4079-9e3f-591639090733 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:48.447119 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb5166-217a-4079-9e3f-591639090733 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:48.447394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb5166-217a-4079-9e3f-591639090733 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:48.448122 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb5166-217a-4079-9e3f-591639090733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:07:48.448417 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb5166-217a-4079-9e3f-591639090733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:48.449820 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb5166-217a-4079-9e3f-591639090733 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:48.462460 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 431/837] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:07:48.468071 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35628a-fe8d-4e20-b824-5a3253c16c6a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:48.541963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:48.574536 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35628a-fe8d-4e20-b824-5a3253c16c6a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:48.609122 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858f602-435b-46d1-a49d-28c93d64e87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:48.609883 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858f602-435b-46d1-a49d-28c93d64e87c None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:48.610144 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858f602-435b-46d1-a49d-28c93d64e87c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:48.610413 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858f602-435b-46d1-a49d-28c93d64e87c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:48.617490 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858f602-435b-46d1-a49d-28c93d64e87c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:48.619030 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858f602-435b-46d1-a49d-28c93d64e87c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:48.631236 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-2858f602-435b-46d1-a49d-28c93d64e87c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:07:48.631236 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:07:48.631236 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:07:48.631236 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:07:48.631236 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:07:48.631236 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:07:48.631236 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:07:48.631236 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:07:48.631236 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:07:48.631236 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:07:48.631236 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:07:48.631236 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:07:48.631236 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:07:48.631236 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:07:48.631236 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:07:48.632159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:07:48.632159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:07:48.632159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:07:48.632159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:07:48.632159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:07:48.632159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:07:48.632159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:07:48.632159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:07:48.632159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:07:48.632159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:07:48.632159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:07:48.632159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:07:48.632159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:07:48.632159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:07:48.632159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:07:48.632159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:07:48.632159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:07:48.633102 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:07:48.633102 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:07:48.633102 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:07:48.633102 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:07:48.633102 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:07:48.633102 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:07:48.633102 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:07:48.633102 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:07:48.633102 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 407/838] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:07:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:07:48.638783 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb5166-217a-4079-9e3f-591639090733 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:48.762961 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb5166-217a-4079-9e3f-591639090733 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:48.780171 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:48.800815 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2ccaa-5002-47db-87ec-516ba6350b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:48.801428 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2ccaa-5002-47db-87ec-516ba6350b5b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:48.801720 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2ccaa-5002-47db-87ec-516ba6350b5b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:48.801999 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2ccaa-5002-47db-87ec-516ba6350b5b None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:48.802683 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2ccaa-5002-47db-87ec-516ba6350b5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:07:48.803039 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2ccaa-5002-47db-87ec-516ba6350b5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:48.804463 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2ccaa-5002-47db-87ec-516ba6350b5b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:48.815930 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 432/839] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 15:07:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:07:48.822186 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858f602-435b-46d1-a49d-28c93d64e87c None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:48.927472 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858f602-435b-46d1-a49d-28c93d64e87c None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:48.955434 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:48.961419 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4606a0c-d147-420d-b9fc-79ded2ba6afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:48.962079 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4606a0c-d147-420d-b9fc-79ded2ba6afa None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:48.962345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4606a0c-d147-420d-b9fc-79ded2ba6afa None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:48.962612 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4606a0c-d147-420d-b9fc-79ded2ba6afa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:48.963324 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4606a0c-d147-420d-b9fc-79ded2ba6afa None admin] RBAC: Adding query filter params (role.id=008dc5c4798945a8bc61788f87211b2a, scope.project.id=1fd85e9620ea42a69363d006d715ad04, user.id=1d4347073208466b885d960d92bdbc77) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:07:48.963631 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4606a0c-d147-420d-b9fc-79ded2ba6afa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:48.965094 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4606a0c-d147-420d-b9fc-79ded2ba6afa None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:48.970623 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 408/840] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:07:48 2022] GET /identity/v3/role_assignments?user.id=1d4347073208466b885d960d92bdbc77&scope.project.id=1fd85e9620ea42a69363d006d715ad04&role.id=008dc5c4798945a8bc61788f87211b2a => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:07:51.640426 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2f8d3-ee34-4691-b3f6-15b577248682 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:51.641042 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2f8d3-ee34-4691-b3f6-15b577248682 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:51.641042 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2f8d3-ee34-4691-b3f6-15b577248682 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:51.642633 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 433/841] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:07:51.648091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df646b99-6ea3-4fd8-af5f-4b698e3d2a6a None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:51.648625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df646b99-6ea3-4fd8-af5f-4b698e3d2a6a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:51.648625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df646b99-6ea3-4fd8-af5f-4b698e3d2a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:51.667748 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-df646b99-6ea3-4fd8-af5f-4b698e3d2a6a None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:07:51.668929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-df646b99-6ea3-4fd8-af5f-4b698e3d2a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:07:51.743683 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 409/842] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:07:51 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:07:52.064296 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2f8d3-ee34-4691-b3f6-15b577248682 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:52.181951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2f8d3-ee34-4691-b3f6-15b577248682 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:52.217384 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfce91d-afc0-47ae-861a-d7176cf6e600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:52.218202 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfce91d-afc0-47ae-861a-d7176cf6e600 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:52.218577 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfce91d-afc0-47ae-861a-d7176cf6e600 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:52.218945 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfce91d-afc0-47ae-861a-d7176cf6e600 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:52.230266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfce91d-afc0-47ae-861a-d7176cf6e600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:07:52.235081 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-dbfce91d-afc0-47ae-861a-d7176cf6e600 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:07:52.235081 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:07:52.235081 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:07:52.235081 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:07:52.235081 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:07:52.235081 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:07:52.235081 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:07:52.235081 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:07:52.235081 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:07:52.235081 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:07:52.235081 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:07:52.235081 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:07:52.235081 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:07:52.235081 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:07:52.235081 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:07:52.235081 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:07:52.236487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:07:52.236487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:07:52.236487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:07:52.236487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:07:52.236487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:07:52.236487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:07:52.236487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:07:52.236487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:07:52.236487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:07:52.236487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:07:52.236487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:07:52.236487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:07:52.236487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:07:52.236487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:07:52.236487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:07:52.236487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:07:52.237568 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:07:52.237568 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:07:52.237568 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:07:52.237568 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:07:52.237568 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:07:52.237568 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:07:52.237568 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:07:52.237568 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:07:52.237568 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:07:52.237568 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:07:52.237568 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:07:52.237568 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:07:52.237568 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 434/843] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 15:07:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:07:52.243244 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df646b99-6ea3-4fd8-af5f-4b698e3d2a6a None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:52.356614 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df646b99-6ea3-4fd8-af5f-4b698e3d2a6a None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:52.381571 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:52.397481 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382e7bf-bd28-453b-a242-a09887656dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:52.398462 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382e7bf-bd28-453b-a242-a09887656dcc None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:52.398850 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382e7bf-bd28-453b-a242-a09887656dcc None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:52.399181 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382e7bf-bd28-453b-a242-a09887656dcc None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:52.399912 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382e7bf-bd28-453b-a242-a09887656dcc None admin] RBAC: Adding query filter params (name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:07:52.400270 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382e7bf-bd28-453b-a242-a09887656dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:52.402188 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382e7bf-bd28-453b-a242-a09887656dcc None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:52.413754 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 410/844] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 15:07:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:07:52.418683 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfce91d-afc0-47ae-861a-d7176cf6e600 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:52.464607 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:52.528525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfce91d-afc0-47ae-861a-d7176cf6e600 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:52.566852 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86809e7-0578-4c88-9a40-b89f8528ac18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:52.567483 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86809e7-0578-4c88-9a40-b89f8528ac18 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:52.567759 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86809e7-0578-4c88-9a40-b89f8528ac18 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:52.568024 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86809e7-0578-4c88-9a40-b89f8528ac18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:52.579127 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86809e7-0578-4c88-9a40-b89f8528ac18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:52.580705 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86809e7-0578-4c88-9a40-b89f8528ac18 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:52.596106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-b86809e7-0578-4c88-9a40-b89f8528ac18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:07:52.596106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:07:52.596106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:07:52.596106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:07:52.596106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:07:52.596106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:07:52.596106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:07:52.596106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:07:52.596106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:07:52.596106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:07:52.596106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:07:52.596106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:07:52.596106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:07:52.596106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:07:52.596106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:07:52.596106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:07:52.597265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:07:52.597265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:07:52.597265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:07:52.597265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:07:52.597265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:07:52.597265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:07:52.597265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:07:52.597265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:07:52.597265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:07:52.597265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:07:52.597265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:07:52.597265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:07:52.597265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:07:52.597265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:07:52.597265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:07:52.597265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:07:52.597265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:07:52.598243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:07:52.598243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:07:52.598243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:07:52.598243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 435/845] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:07:52.603425 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382e7bf-bd28-453b-a242-a09887656dcc None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:52.709948 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382e7bf-bd28-453b-a242-a09887656dcc None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:52.747275 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9e7ea-d53d-4ee0-b78f-8fc6dbd6bf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:52.747945 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9e7ea-d53d-4ee0-b78f-8fc6dbd6bf8b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:52.748179 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9e7ea-d53d-4ee0-b78f-8fc6dbd6bf8b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:52.748435 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9e7ea-d53d-4ee0-b78f-8fc6dbd6bf8b None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:52.749078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9e7ea-d53d-4ee0-b78f-8fc6dbd6bf8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:07:52.749376 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9e7ea-d53d-4ee0-b78f-8fc6dbd6bf8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:52.750775 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9e7ea-d53d-4ee0-b78f-8fc6dbd6bf8b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:52.762740 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 411/846] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:07:52.768779 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86809e7-0578-4c88-9a40-b89f8528ac18 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:52.862524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:52.873047 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86809e7-0578-4c88-9a40-b89f8528ac18 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:52.910387 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a22b11-1684-4edc-b568-afcbc8bb2d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:52.910980 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a22b11-1684-4edc-b568-afcbc8bb2d71 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:52.911270 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a22b11-1684-4edc-b568-afcbc8bb2d71 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:52.911568 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a22b11-1684-4edc-b568-afcbc8bb2d71 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:52.919766 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a22b11-1684-4edc-b568-afcbc8bb2d71 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:52.921396 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a22b11-1684-4edc-b568-afcbc8bb2d71 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:52.933812 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-c5a22b11-1684-4edc-b568-afcbc8bb2d71 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:07:52.933812 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:07:52.933812 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:07:52.933812 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:07:52.933812 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:07:52.933812 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:07:52.933812 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:07:52.933812 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:07:52.933812 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:07:52.933812 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:07:52.933812 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:07:52.933812 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:07:52.933812 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:07:52.933812 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:07:52.933812 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:07:52.933812 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:07:52.934828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:07:52.934828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:07:52.934828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:07:52.934828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:07:52.934828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:07:52.934828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:07:52.934828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:07:52.934828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:07:52.934828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:07:52.934828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:07:52.934828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:07:52.934828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:07:52.934828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:07:52.934828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:07:52.934828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:07:52.934828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:07:52.934828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:07:52.934828 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:07:52.935915 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:07:52.935915 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:07:52.935915 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:07:52.935915 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:07:52.935915 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:07:52.935915 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:07:52.935915 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:07:52.935915 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:07:52.935915 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:07:52.935915 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:07:52.935915 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 436/847] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:07:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:07:52.941285 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9e7ea-d53d-4ee0-b78f-8fc6dbd6bf8b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:52.993057 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:53.059038 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9e7ea-d53d-4ee0-b78f-8fc6dbd6bf8b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:53.098363 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49943baa-5e1d-4aba-9e67-b3023d5ca5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:53.098979 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49943baa-5e1d-4aba-9e67-b3023d5ca5cb None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:53.099316 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49943baa-5e1d-4aba-9e67-b3023d5ca5cb None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:53.099651 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49943baa-5e1d-4aba-9e67-b3023d5ca5cb None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:53.100553 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49943baa-5e1d-4aba-9e67-b3023d5ca5cb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:07:53.100930 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49943baa-5e1d-4aba-9e67-b3023d5ca5cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:53.102566 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49943baa-5e1d-4aba-9e67-b3023d5ca5cb None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:53.122831 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 412/848] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Sep 23 15:07:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:07:53.128635 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a22b11-1684-4edc-b568-afcbc8bb2d71 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:53.231794 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a22b11-1684-4edc-b568-afcbc8bb2d71 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:53.266855 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9dc6b-5af4-407d-92da-711042a03832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:53.267402 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9dc6b-5af4-407d-92da-711042a03832 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:53.267675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9dc6b-5af4-407d-92da-711042a03832 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:53.267942 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9dc6b-5af4-407d-92da-711042a03832 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:53.278905 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9dc6b-5af4-407d-92da-711042a03832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:53.280498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9dc6b-5af4-407d-92da-711042a03832 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:53.294823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-79a9dc6b-5af4-407d-92da-711042a03832 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:07:53.294823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:07:53.294823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:07:53.294823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:07:53.294823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:07:53.294823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:07:53.294823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:07:53.294823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:07:53.294823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:07:53.294823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:07:53.294823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:07:53.294823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:07:53.294823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:07:53.294823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:07:53.294823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:07:53.294823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:07:53.295844 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:07:53.295844 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:07:53.295844 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:07:53.295844 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:07:53.295844 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:07:53.295844 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:07:53.295844 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:07:53.295844 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:07:53.295844 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:07:53.295844 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:07:53.295844 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:07:53.295844 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:07:53.295844 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:07:53.295844 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:07:53.295844 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:07:53.295844 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:07:53.295844 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:07:53.297092 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:07:53.297092 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:07:53.297092 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:07:53.297092 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 437/849] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:07:53.301992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49943baa-5e1d-4aba-9e67-b3023d5ca5cb None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:53.415077 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49943baa-5e1d-4aba-9e67-b3023d5ca5cb None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:53.418653 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:53.454517 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45d1cb-8d25-42da-94a2-11e372c8ca1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:53.455119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45d1cb-8d25-42da-94a2-11e372c8ca1b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:53.455393 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45d1cb-8d25-42da-94a2-11e372c8ca1b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:53.455656 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45d1cb-8d25-42da-94a2-11e372c8ca1b None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:53.456281 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45d1cb-8d25-42da-94a2-11e372c8ca1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:07:53.456574 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45d1cb-8d25-42da-94a2-11e372c8ca1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:53.457961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45d1cb-8d25-42da-94a2-11e372c8ca1b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:53.469368 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 413/850] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:07:53.475392 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9dc6b-5af4-407d-92da-711042a03832 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:53.478584 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:53.581625 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9dc6b-5af4-407d-92da-711042a03832 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:53.615590 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dec51a-ea4f-40bc-8f42-ccbbad4187d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:53.616228 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dec51a-ea4f-40bc-8f42-ccbbad4187d7 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:53.616488 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dec51a-ea4f-40bc-8f42-ccbbad4187d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:53.616758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dec51a-ea4f-40bc-8f42-ccbbad4187d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:53.623374 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dec51a-ea4f-40bc-8f42-ccbbad4187d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:53.624823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dec51a-ea4f-40bc-8f42-ccbbad4187d7 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:53.635838 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-a2dec51a-ea4f-40bc-8f42-ccbbad4187d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:07:53.635838 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:07:53.635838 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:07:53.635838 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:07:53.635838 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:07:53.635838 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:07:53.635838 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:07:53.635838 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:07:53.635838 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:07:53.635838 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:07:53.635838 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:07:53.635838 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:07:53.635838 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:07:53.635838 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:07:53.635838 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:07:53.636967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:07:53.636967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:07:53.636967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:07:53.636967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:07:53.636967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:07:53.636967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:07:53.636967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:07:53.636967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:07:53.636967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:07:53.636967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:07:53.636967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:07:53.636967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:07:53.636967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:07:53.636967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:07:53.636967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:07:53.636967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:07:53.636967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:07:53.638292 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:07:53.638292 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:07:53.638292 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:07:53.638292 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:07:53.638292 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:07:53.638292 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:07:53.638292 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:07:53.638292 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:07:53.638292 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 438/851] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:07:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:07:53.643018 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45d1cb-8d25-42da-94a2-11e372c8ca1b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:53.744126 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45d1cb-8d25-42da-94a2-11e372c8ca1b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:53.778996 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c1488-0f00-4478-a389-bb6ccaefc974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:53.779609 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c1488-0f00-4478-a389-bb6ccaefc974 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:53.779885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c1488-0f00-4478-a389-bb6ccaefc974 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:53.780160 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c1488-0f00-4478-a389-bb6ccaefc974 None admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:53.780847 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c1488-0f00-4478-a389-bb6ccaefc974 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:07:53.781146 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c1488-0f00-4478-a389-bb6ccaefc974 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:53.782618 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c1488-0f00-4478-a389-bb6ccaefc974 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:53.794794 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 414/852] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 15:07:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:07:53.800644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dec51a-ea4f-40bc-8f42-ccbbad4187d7 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:53.868298 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:53.913488 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dec51a-ea4f-40bc-8f42-ccbbad4187d7 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:53.949553 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7223d4-b30d-44f6-ad7c-d732d4dd7921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:53.950273 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7223d4-b30d-44f6-ad7c-d732d4dd7921 None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:53.950549 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7223d4-b30d-44f6-ad7c-d732d4dd7921 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:53.950833 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7223d4-b30d-44f6-ad7c-d732d4dd7921 None admin] PATH_INFO: `/v3/projects/1fd85e9620ea42a69363d006d715ad04/users/1d4347073208466b885d960d92bdbc77/roles/008dc5c4798945a8bc61788f87211b2a` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:53.967589 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7223d4-b30d-44f6-ad7c-d732d4dd7921 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fd85e9620ea42a69363d006d715ad04, user_id=1d4347073208466b885d960d92bdbc77, role_id=008dc5c4798945a8bc61788f87211b2a)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:53.969026 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7223d4-b30d-44f6-ad7c-d732d4dd7921 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:53.982421 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 439/853] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 15:07:53 2022] PUT /identity/v3/projects/1fd85e9620ea42a69363d006d715ad04/users/1d4347073208466b885d960d92bdbc77/roles/008dc5c4798945a8bc61788f87211b2a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:07:56.545061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ea833-e9d8-475c-84da-ba4c64eca659 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:56.545654 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ea833-e9d8-475c-84da-ba4c64eca659 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:56.545768 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ea833-e9d8-475c-84da-ba4c64eca659 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:56.547365 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 415/854] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:07:56.553238 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea3800-530d-4e11-9601-a28f718bdc4b None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:56.553675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea3800-530d-4e11-9601-a28f718bdc4b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:56.553876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea3800-530d-4e11-9601-a28f718bdc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:56.575298 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-c6ea3800-530d-4e11-9601-a28f718bdc4b None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:07:56.576500 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-c6ea3800-530d-4e11-9601-a28f718bdc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:07:56.647830 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 440/855] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:07:56 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:07:56.987985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ea833-e9d8-475c-84da-ba4c64eca659 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:57.017751 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:57.104058 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ea833-e9d8-475c-84da-ba4c64eca659 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:57.139725 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6ad01-7f50-4781-8e5f-1458b88d3226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:57.140358 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6ad01-7f50-4781-8e5f-1458b88d3226 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:57.140630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6ad01-7f50-4781-8e5f-1458b88d3226 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:57.140951 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6ad01-7f50-4781-8e5f-1458b88d3226 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:57.153831 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6ad01-7f50-4781-8e5f-1458b88d3226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:07:57.159583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-24b6ad01-7f50-4781-8e5f-1458b88d3226 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:07:57.159583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:07:57.159583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:07:57.159583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:07:57.159583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:07:57.159583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:07:57.159583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:07:57.159583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:07:57.159583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:07:57.159583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:07:57.159583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:07:57.159583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:07:57.159583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:07:57.159583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:07:57.159583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:07:57.159583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:07:57.160766 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:07:57.160766 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:07:57.160766 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:07:57.160766 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:07:57.160766 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:07:57.160766 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:07:57.160766 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:07:57.160766 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:07:57.160766 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:07:57.160766 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:07:57.160766 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:07:57.160766 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:07:57.160766 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:07:57.160766 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:07:57.160766 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:07:57.160766 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:07:57.162073 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:07:57.162073 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:07:57.162073 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:07:57.162073 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:07:57.162073 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:07:57.162073 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:07:57.162073 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:07:57.162073 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:07:57.162073 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:07:57.162073 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:07:57.162073 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:07:57.162073 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:07:57.162073 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 416/856] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 15:07:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:07:57.167330 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea3800-530d-4e11-9601-a28f718bdc4b None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:57.211516 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:57.273439 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea3800-530d-4e11-9601-a28f718bdc4b None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:57.313956 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506c443-4091-460a-8ec1-0451ee10312d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:57.314559 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506c443-4091-460a-8ec1-0451ee10312d None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:57.314832 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506c443-4091-460a-8ec1-0451ee10312d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:57.315100 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506c443-4091-460a-8ec1-0451ee10312d None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:57.315757 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506c443-4091-460a-8ec1-0451ee10312d None admin] RBAC: Adding query filter params (name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:07:57.316058 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506c443-4091-460a-8ec1-0451ee10312d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:57.317460 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506c443-4091-460a-8ec1-0451ee10312d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:57.326376 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 441/857] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 15:07:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:07:57.332786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6ad01-7f50-4781-8e5f-1458b88d3226 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:57.439019 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:57.459911 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6ad01-7f50-4781-8e5f-1458b88d3226 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:57.500198 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78be4d-3060-44b8-a514-32d03b304e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:57.500960 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78be4d-3060-44b8-a514-32d03b304e8e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:57.501234 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78be4d-3060-44b8-a514-32d03b304e8e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:57.501502 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78be4d-3060-44b8-a514-32d03b304e8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:57.511885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78be4d-3060-44b8-a514-32d03b304e8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:57.513427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78be4d-3060-44b8-a514-32d03b304e8e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:57.530005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-0f78be4d-3060-44b8-a514-32d03b304e8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:07:57.530005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:07:57.530005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:07:57.530005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:07:57.530005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:07:57.530005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:07:57.530005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:07:57.530005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:07:57.530005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:07:57.530005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:07:57.530005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:07:57.530005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:07:57.530005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:07:57.530005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:07:57.530005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:07:57.530005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:07:57.531096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:07:57.531096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:07:57.531096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:07:57.531096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:07:57.531096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:07:57.531096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:07:57.531096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:07:57.531096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:07:57.531096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:07:57.531096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:07:57.531096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:07:57.531096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:07:57.531096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:07:57.531096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:07:57.531096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:07:57.531096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:07:57.531096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:07:57.532019 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:07:57.532019 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:07:57.532019 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:07:57.532019 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 417/858] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:07:57.537727 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506c443-4091-460a-8ec1-0451ee10312d None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:57.649883 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506c443-4091-460a-8ec1-0451ee10312d None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:57.652705 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:57.690200 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d8c0f-f299-4baf-b88c-bcc7b45eedaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:57.690805 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d8c0f-f299-4baf-b88c-bcc7b45eedaa None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:57.691076 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d8c0f-f299-4baf-b88c-bcc7b45eedaa None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:57.691371 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d8c0f-f299-4baf-b88c-bcc7b45eedaa None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:57.691968 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d8c0f-f299-4baf-b88c-bcc7b45eedaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:07:57.692264 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d8c0f-f299-4baf-b88c-bcc7b45eedaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:57.693612 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d8c0f-f299-4baf-b88c-bcc7b45eedaa None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:57.706442 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 442/859] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:07:57.712946 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78be4d-3060-44b8-a514-32d03b304e8e None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:57.822103 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78be4d-3060-44b8-a514-32d03b304e8e None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:57.859005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c314bd8-6549-4ab6-a365-e078b2389c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:57.859639 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c314bd8-6549-4ab6-a365-e078b2389c47 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:57.859917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c314bd8-6549-4ab6-a365-e078b2389c47 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:57.860191 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c314bd8-6549-4ab6-a365-e078b2389c47 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:57.862898 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:57.868823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c314bd8-6549-4ab6-a365-e078b2389c47 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:57.871119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c314bd8-6549-4ab6-a365-e078b2389c47 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:57.885580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-7c314bd8-6549-4ab6-a365-e078b2389c47 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:07:57.885580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:07:57.885580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:07:57.885580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:07:57.885580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:07:57.885580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:07:57.885580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:07:57.885580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:07:57.885580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:07:57.885580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:07:57.885580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:07:57.885580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:07:57.885580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:07:57.885580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:07:57.885580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:07:57.885580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:07:57.886697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:07:57.886697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:07:57.886697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:07:57.886697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:07:57.886697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:07:57.886697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:07:57.886697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:07:57.886697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:07:57.886697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:07:57.886697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:07:57.886697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:07:57.886697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:07:57.886697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:07:57.886697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:07:57.886697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:07:57.886697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:07:57.886697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:07:57.886697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:07:57.887667 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:07:57.887667 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:07:57.887667 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:07:57.887667 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:07:57.887667 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:07:57.887667 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:07:57.887667 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:07:57.887667 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:07:57.887667 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:07:57.887667 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:07:57.887667 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 418/860] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:07:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:07:57.893644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d8c0f-f299-4baf-b88c-bcc7b45eedaa None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:58.012633 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d8c0f-f299-4baf-b88c-bcc7b45eedaa None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:58.055440 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbfdf6-399b-4fbf-b9a8-9a8f72db4f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:58.056060 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbfdf6-399b-4fbf-b9a8-9a8f72db4f7c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:58.056336 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbfdf6-399b-4fbf-b9a8-9a8f72db4f7c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:58.056605 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbfdf6-399b-4fbf-b9a8-9a8f72db4f7c None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:58.057336 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fbfdf6-399b-4fbf-b9a8-9a8f72db4f7c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:07:58.057675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fbfdf6-399b-4fbf-b9a8-9a8f72db4f7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:58.059422 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fbfdf6-399b-4fbf-b9a8-9a8f72db4f7c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:58.086974 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 443/861] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Sep 23 15:07:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:07:58.088365 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c314bd8-6549-4ab6-a365-e078b2389c47 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:58.207185 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c314bd8-6549-4ab6-a365-e078b2389c47 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:58.249660 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e792b-27c0-419f-bf0c-c7f96f82bbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:58.250328 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e792b-27c0-419f-bf0c-c7f96f82bbfb None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:58.250602 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e792b-27c0-419f-bf0c-c7f96f82bbfb None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:58.250926 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e792b-27c0-419f-bf0c-c7f96f82bbfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:58.322291 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:58.331226 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e792b-27c0-419f-bf0c-c7f96f82bbfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:58.332697 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e792b-27c0-419f-bf0c-c7f96f82bbfb None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:58.453829 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 419/862] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:07:58 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 23 15:07:58.458982 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbfdf6-399b-4fbf-b9a8-9a8f72db4f7c None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:58.486679 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:58.577957 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbfdf6-399b-4fbf-b9a8-9a8f72db4f7c None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:58.616123 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92615e1-89b9-4946-88a8-161cbe479d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:58.616726 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92615e1-89b9-4946-88a8-161cbe479d90 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:58.617145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92615e1-89b9-4946-88a8-161cbe479d90 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:58.617303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92615e1-89b9-4946-88a8-161cbe479d90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:58.630530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92615e1-89b9-4946-88a8-161cbe479d90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:58.632873 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92615e1-89b9-4946-88a8-161cbe479d90 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:58.651342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-a92615e1-89b9-4946-88a8-161cbe479d90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:07:58.651342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:07:58.651342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:07:58.651342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:07:58.651342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:07:58.651342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:07:58.651342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:07:58.651342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:07:58.651342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:07:58.651342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:07:58.651342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:07:58.651342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:07:58.651342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:07:58.651342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:07:58.651342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:07:58.651342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:07:58.652914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:07:58.652914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:07:58.652914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:07:58.652914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:07:58.652914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:07:58.652914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:07:58.652914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:07:58.652914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:07:58.652914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:07:58.652914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:07:58.652914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:07:58.652914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:07:58.652914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:07:58.652914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:07:58.652914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:07:58.652914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:07:58.652914 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:07:58.654260 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:07:58.654260 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:07:58.654260 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:07:58.654260 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 444/863] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:07:58.659051 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e792b-27c0-419f-bf0c-c7f96f82bbfb None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:58.761035 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:58.767689 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e792b-27c0-419f-bf0c-c7f96f82bbfb None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:58.802515 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a668ea5-d3ec-4591-8165-b5a5b541b56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:58.803355 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a668ea5-d3ec-4591-8165-b5a5b541b56f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:58.803626 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a668ea5-d3ec-4591-8165-b5a5b541b56f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:58.803934 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a668ea5-d3ec-4591-8165-b5a5b541b56f None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:58.804549 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a668ea5-d3ec-4591-8165-b5a5b541b56f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:07:58.804820 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a668ea5-d3ec-4591-8165-b5a5b541b56f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:58.806213 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a668ea5-d3ec-4591-8165-b5a5b541b56f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:58.817371 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 420/864] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:07:58.823057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92615e1-89b9-4946-88a8-161cbe479d90 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:58.903897 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:58.934530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92615e1-89b9-4946-88a8-161cbe479d90 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:58.976328 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411c91d-0abc-4540-b69a-02623de648a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:58.977253 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411c91d-0abc-4540-b69a-02623de648a1 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:58.977632 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411c91d-0abc-4540-b69a-02623de648a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:58.978020 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411c91d-0abc-4540-b69a-02623de648a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:58.987152 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411c91d-0abc-4540-b69a-02623de648a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:58.988978 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411c91d-0abc-4540-b69a-02623de648a1 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:59.003309 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-0411c91d-0abc-4540-b69a-02623de648a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:07:59.003309 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:07:59.003309 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:07:59.003309 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:07:59.003309 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:07:59.003309 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:07:59.003309 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:07:59.003309 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:07:59.003309 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:07:59.003309 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:07:59.003309 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:07:59.003309 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:07:59.003309 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:07:59.003309 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:07:59.003309 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:07:59.004887 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:07:59.004887 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:07:59.004887 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:07:59.004887 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:07:59.004887 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:07:59.004887 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:07:59.004887 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:07:59.004887 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:07:59.004887 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:07:59.004887 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:07:59.004887 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:07:59.004887 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:07:59.004887 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:07:59.004887 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:07:59.004887 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:07:59.004887 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:07:59.004887 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:07:59.005857 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:07:59.005857 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:07:59.005857 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:07:59.005857 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:07:59.005857 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:07:59.005857 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:07:59.005857 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:07:59.005857 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:07:59.005857 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 445/865] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:07:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:07:59.010863 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a668ea5-d3ec-4591-8165-b5a5b541b56f None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:59.130783 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a668ea5-d3ec-4591-8165-b5a5b541b56f None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:59.169531 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6fc9e-9813-4c94-9bc2-e5de77e8de78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:59.170167 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6fc9e-9813-4c94-9bc2-e5de77e8de78 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:59.170483 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6fc9e-9813-4c94-9bc2-e5de77e8de78 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:59.170757 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6fc9e-9813-4c94-9bc2-e5de77e8de78 None admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:59.171453 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6fc9e-9813-4c94-9bc2-e5de77e8de78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:07:59.171756 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6fc9e-9813-4c94-9bc2-e5de77e8de78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:59.173194 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6fc9e-9813-4c94-9bc2-e5de77e8de78 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:59.186310 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 421/866] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 15:07:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:07:59.192805 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411c91d-0abc-4540-b69a-02623de648a1 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:07:59.320088 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411c91d-0abc-4540-b69a-02623de648a1 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:07:59.362387 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8e2a4-475f-4184-90d8-2379419d647c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:07:59.363141 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8e2a4-475f-4184-90d8-2379419d647c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:07:59.363457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8e2a4-475f-4184-90d8-2379419d647c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:07:59.363799 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8e2a4-475f-4184-90d8-2379419d647c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:07:59.364707 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8e2a4-475f-4184-90d8-2379419d647c None admin] RBAC: Adding query filter params (role.id=008dc5c4798945a8bc61788f87211b2a, scope.project.id=1fd85e9620ea42a69363d006d715ad04, user.id=1d4347073208466b885d960d92bdbc77) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:07:59.365155 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8e2a4-475f-4184-90d8-2379419d647c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:07:59.366709 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8e2a4-475f-4184-90d8-2379419d647c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:07:59.368484 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:07:59.385725 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 446/867] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:07:59 2022] GET /identity/v3/role_assignments?user.id=1d4347073208466b885d960d92bdbc77&scope.project.id=1fd85e9620ea42a69363d006d715ad04&role.id=008dc5c4798945a8bc61788f87211b2a => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:01.955667 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a36e0e-5ba9-494e-b6f5-b2dc4af025fb None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:01.956201 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a36e0e-5ba9-494e-b6f5-b2dc4af025fb None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:01.956201 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a36e0e-5ba9-494e-b6f5-b2dc4af025fb None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:01.957631 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 422/868] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:01.963494 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964e712-3053-498a-9d57-77b172764e04 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:01.963987 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964e712-3053-498a-9d57-77b172764e04 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:01.963987 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964e712-3053-498a-9d57-77b172764e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:01.984193 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-7964e712-3053-498a-9d57-77b172764e04 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:01.985416 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-7964e712-3053-498a-9d57-77b172764e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:02.053972 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 447/869] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:01 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:08:02.372449 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a36e0e-5ba9-494e-b6f5-b2dc4af025fb None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:02.400158 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:02.494656 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a36e0e-5ba9-494e-b6f5-b2dc4af025fb None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:02.531345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e1d1a-2826-4450-a1cc-7e25a88e4bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:02.531973 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e1d1a-2826-4450-a1cc-7e25a88e4bd6 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:02.532245 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e1d1a-2826-4450-a1cc-7e25a88e4bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:02.532513 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e1d1a-2826-4450-a1cc-7e25a88e4bd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:02.543658 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e1d1a-2826-4450-a1cc-7e25a88e4bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:08:02.548529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-f19e1d1a-2826-4450-a1cc-7e25a88e4bd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:08:02.548529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:02.548529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:02.548529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:02.548529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:02.548529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:02.548529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:02.548529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:02.548529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:02.548529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:02.548529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:02.548529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:02.548529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:08:02.548529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:08:02.548529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:08:02.548529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:08:02.549640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:08:02.549640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:08:02.549640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:08:02.549640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:08:02.549640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:02.549640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:02.549640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:02.549640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:02.549640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:02.549640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:02.549640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:02.549640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:02.549640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:02.549640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:02.549640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:02.549640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:02.550663 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:02.550663 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:02.550663 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:02.550663 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:02.550663 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:08:02.550663 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:08:02.550663 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:08:02.550663 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:08:02.550663 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:08:02.550663 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:08:02.550663 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:08:02.550663 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:08:02.550663 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 423/870] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 15:08:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:02.555883 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964e712-3053-498a-9d57-77b172764e04 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:02.673223 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964e712-3053-498a-9d57-77b172764e04 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:02.698292 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:02.706705 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc6f28-fc50-486d-9a15-9a1428c77fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:02.707302 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc6f28-fc50-486d-9a15-9a1428c77fa7 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:02.707573 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc6f28-fc50-486d-9a15-9a1428c77fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:02.707843 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc6f28-fc50-486d-9a15-9a1428c77fa7 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:02.708494 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc6f28-fc50-486d-9a15-9a1428c77fa7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:02.708794 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc6f28-fc50-486d-9a15-9a1428c77fa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:02.710257 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc6f28-fc50-486d-9a15-9a1428c77fa7 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:02.719426 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 448/871] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:08:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:02.724310 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e1d1a-2826-4450-a1cc-7e25a88e4bd6 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:02.805060 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:02.829675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e1d1a-2826-4450-a1cc-7e25a88e4bd6 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:02.865330 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5c446-017e-40c7-9e85-7bcd03d70f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:02.866009 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5c446-017e-40c7-9e85-7bcd03d70f8a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:02.866281 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5c446-017e-40c7-9e85-7bcd03d70f8a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:02.866545 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5c446-017e-40c7-9e85-7bcd03d70f8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:02.876822 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5c446-017e-40c7-9e85-7bcd03d70f8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:02.878298 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5c446-017e-40c7-9e85-7bcd03d70f8a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:02.892886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-15b5c446-017e-40c7-9e85-7bcd03d70f8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:08:02.892886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:02.892886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:02.892886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:02.892886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:02.892886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:02.892886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:02.892886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:02.892886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:02.892886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:02.892886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:02.892886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:02.892886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:08:02.892886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:08:02.892886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:08:02.892886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:08:02.894005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:02.894005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:02.894005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:02.894005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:02.894005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:02.894005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:02.894005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:02.894005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:02.894005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:02.894005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:02.894005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:02.894005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:02.894005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:02.894005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:02.894005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:02.894005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:02.894005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:08:02.895081 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:08:02.895081 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:08:02.895081 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:08:02.895081 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 424/872] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:02.899879 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc6f28-fc50-486d-9a15-9a1428c77fa7 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:03.008547 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc6f28-fc50-486d-9a15-9a1428c77fa7 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:03.048998 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93cd90-bd5f-4f16-aacf-a35e59117bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:03.049582 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93cd90-bd5f-4f16-aacf-a35e59117bd6 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:03.049889 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93cd90-bd5f-4f16-aacf-a35e59117bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:03.050151 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93cd90-bd5f-4f16-aacf-a35e59117bd6 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:03.050777 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93cd90-bd5f-4f16-aacf-a35e59117bd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:03.051061 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93cd90-bd5f-4f16-aacf-a35e59117bd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:03.052406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93cd90-bd5f-4f16-aacf-a35e59117bd6 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:03.070538 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 449/873] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:03.078743 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5c446-017e-40c7-9e85-7bcd03d70f8a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:03.184955 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5c446-017e-40c7-9e85-7bcd03d70f8a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:03.211533 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:03.225560 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cd839-d8a7-4525-bb0c-9bd98e643e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:03.226215 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cd839-d8a7-4525-bb0c-9bd98e643e38 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:03.226491 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cd839-d8a7-4525-bb0c-9bd98e643e38 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:03.226755 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cd839-d8a7-4525-bb0c-9bd98e643e38 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:03.234786 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6cd839-d8a7-4525-bb0c-9bd98e643e38 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:03.236224 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6cd839-d8a7-4525-bb0c-9bd98e643e38 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:03.247331 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-cf6cd839-d8a7-4525-bb0c-9bd98e643e38 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:08:03.247331 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:03.247331 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:03.247331 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:03.247331 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:03.247331 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:03.247331 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:03.247331 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:03.247331 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:03.247331 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:03.247331 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:03.247331 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:03.247331 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:08:03.247331 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:08:03.247331 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:08:03.247331 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:08:03.248386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:03.248386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:03.248386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:08:03.248386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:08:03.248386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:08:03.248386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:08:03.248386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:03.248386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:03.248386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:03.248386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:03.248386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:03.248386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:03.248386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:03.248386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:03.248386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:03.248386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:03.248386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:03.248386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:03.249533 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:03.249533 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:03.249533 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:08:03.249533 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:08:03.249533 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:08:03.249533 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:08:03.249533 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:08:03.249533 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:08:03.249533 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:08:03.249533 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:08:03.253140 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 425/874] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:08:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:03.254337 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93cd90-bd5f-4f16-aacf-a35e59117bd6 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:03.307057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:03.358610 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93cd90-bd5f-4f16-aacf-a35e59117bd6 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:03.396866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55cef6-046f-4a9c-8c90-80608df5a641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:03.397673 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55cef6-046f-4a9c-8c90-80608df5a641 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:03.398109 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55cef6-046f-4a9c-8c90-80608df5a641 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:03.398381 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55cef6-046f-4a9c-8c90-80608df5a641 None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:03.399516 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55cef6-046f-4a9c-8c90-80608df5a641 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:03.399858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55cef6-046f-4a9c-8c90-80608df5a641 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:03.402319 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55cef6-046f-4a9c-8c90-80608df5a641 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:03.426759 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 450/875] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Sep 23 15:08:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:03.433670 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cd839-d8a7-4525-bb0c-9bd98e643e38 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:03.538034 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cd839-d8a7-4525-bb0c-9bd98e643e38 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:03.572296 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc1629-8bf7-4393-8f15-284925e26456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:03.572890 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc1629-8bf7-4393-8f15-284925e26456 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:03.573165 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc1629-8bf7-4393-8f15-284925e26456 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:03.573433 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc1629-8bf7-4393-8f15-284925e26456 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:03.639543 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:03.653311 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc1629-8bf7-4393-8f15-284925e26456 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:03.654794 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc1629-8bf7-4393-8f15-284925e26456 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:03.770557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 426/876] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:08:03 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:08:03.778151 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55cef6-046f-4a9c-8c90-80608df5a641 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:03.891320 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55cef6-046f-4a9c-8c90-80608df5a641 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:03.900948 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:03.928677 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08526774-6fd8-4946-b187-6ec6cb3de12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:03.929358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08526774-6fd8-4946-b187-6ec6cb3de12c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:03.929665 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08526774-6fd8-4946-b187-6ec6cb3de12c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:03.929997 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08526774-6fd8-4946-b187-6ec6cb3de12c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:03.940875 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08526774-6fd8-4946-b187-6ec6cb3de12c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:03.942485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08526774-6fd8-4946-b187-6ec6cb3de12c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:03.958291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-08526774-6fd8-4946-b187-6ec6cb3de12c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:08:03.958291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:03.958291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:03.958291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:03.958291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:03.958291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:03.958291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:03.958291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:03.958291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:03.958291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:03.958291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:03.958291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:03.958291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:08:03.958291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:08:03.958291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:08:03.958291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:08:03.959339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:03.959339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:03.959339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:03.959339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:03.959339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:03.959339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:03.959339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:03.959339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:03.959339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:03.959339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:03.959339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:03.959339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:03.959339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:03.959339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:03.959339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:03.959339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:03.959339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:08:03.961149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:08:03.961149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:08:03.961149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:08:03.961149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 451/877] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:03.968567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc1629-8bf7-4393-8f15-284925e26456 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:04.075341 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:04.088689 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc1629-8bf7-4393-8f15-284925e26456 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:04.124338 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3abe4-c9c1-4e93-8be8-7be1ccc8e13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:04.124932 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3abe4-c9c1-4e93-8be8-7be1ccc8e13d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:04.125201 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3abe4-c9c1-4e93-8be8-7be1ccc8e13d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:04.125464 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3abe4-c9c1-4e93-8be8-7be1ccc8e13d None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:04.126123 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3abe4-c9c1-4e93-8be8-7be1ccc8e13d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:04.126424 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3abe4-c9c1-4e93-8be8-7be1ccc8e13d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:04.127770 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3abe4-c9c1-4e93-8be8-7be1ccc8e13d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:04.138947 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 427/878] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:04.147986 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08526774-6fd8-4946-b187-6ec6cb3de12c None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:04.252237 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08526774-6fd8-4946-b187-6ec6cb3de12c None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:04.286305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc0706-a978-4f99-906f-b1abea2f06be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:04.286905 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc0706-a978-4f99-906f-b1abea2f06be None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:04.287174 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc0706-a978-4f99-906f-b1abea2f06be None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:04.287441 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc0706-a978-4f99-906f-b1abea2f06be None admin] PATH_INFO: `/v3/projects/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:04.294217 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc0706-a978-4f99-906f-b1abea2f06be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:04.295669 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc0706-a978-4f99-906f-b1abea2f06be None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:04.307006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-0cbc0706-a978-4f99-906f-b1abea2f06be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:08:04.307006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:04.307006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:04.307006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:04.307006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:04.307006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:04.307006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:04.307006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:04.307006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:04.307006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:04.307006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:04.307006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:04.307006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:08:04.307006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:08:04.307006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:08:04.308049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:08:04.308049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:04.308049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:04.308049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:04.308049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:04.308049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:04.308049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:04.308049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:04.308049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:04.308049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:04.308049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:04.308049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:04.308049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:04.308049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:04.308049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:04.308049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:04.308049 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:04.309365 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:08:04.309365 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:08:04.309365 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:08:04.309365 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:08:04.309365 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:08:04.309365 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:08:04.309365 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:08:04.309365 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:08:04.309365 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 452/879] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:08:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:04.316901 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3abe4-c9c1-4e93-8be8-7be1ccc8e13d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:04.439818 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3abe4-c9c1-4e93-8be8-7be1ccc8e13d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:04.472185 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda5b04-bc08-428f-ac73-15dc3e330965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:04.472787 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda5b04-bc08-428f-ac73-15dc3e330965 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:04.473058 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda5b04-bc08-428f-ac73-15dc3e330965 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:04.473327 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda5b04-bc08-428f-ac73-15dc3e330965 None admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:04.474033 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda5b04-bc08-428f-ac73-15dc3e330965 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:04.474332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda5b04-bc08-428f-ac73-15dc3e330965 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:04.475780 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda5b04-bc08-428f-ac73-15dc3e330965 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:04.487561 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 428/880] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 15:08:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:04.494102 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc0706-a978-4f99-906f-b1abea2f06be None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:04.520813 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:04.600893 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc0706-a978-4f99-906f-b1abea2f06be None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:04.635582 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc25c75-d1ef-406e-8c93-e049df345845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:04.636163 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc25c75-d1ef-406e-8c93-e049df345845 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:04.636438 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc25c75-d1ef-406e-8c93-e049df345845 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:04.636703 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc25c75-d1ef-406e-8c93-e049df345845 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:04.637409 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc25c75-d1ef-406e-8c93-e049df345845 None admin] RBAC: Adding query filter params (role.id=07d4069c848d4ee9abb586256ee26f20, scope.project.id=1fd85e9620ea42a69363d006d715ad04, user.id=1d4347073208466b885d960d92bdbc77) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:04.637736 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc25c75-d1ef-406e-8c93-e049df345845 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:04.639149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc25c75-d1ef-406e-8c93-e049df345845 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:04.644467 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 453/881] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:08:04 2022] GET /identity/v3/role_assignments?user.id=1d4347073208466b885d960d92bdbc77&scope.project.id=1fd85e9620ea42a69363d006d715ad04&role.id=07d4069c848d4ee9abb586256ee26f20 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:06.967647 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae64211-dcd7-4265-8707-bf6a62920b30 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:06.968843 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae64211-dcd7-4265-8707-bf6a62920b30 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:06.968843 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae64211-dcd7-4265-8707-bf6a62920b30 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:06.970932 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 429/882] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:08:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:06.978128 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035b607-ac92-4590-b5da-4270be736815 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:06.978544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035b607-ac92-4590-b5da-4270be736815 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:06.978635 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035b607-ac92-4590-b5da-4270be736815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:06.997394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-7035b607-ac92-4590-b5da-4270be736815 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:06.998601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-7035b607-ac92-4590-b5da-4270be736815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:07.073153 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 454/883] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:06 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:08:07.390244 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae64211-dcd7-4265-8707-bf6a62920b30 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:07.404815 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:07.506751 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae64211-dcd7-4265-8707-bf6a62920b30 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:07.540396 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ceb6e2-6da8-40c8-bae0-3a822433ed82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:07.541007 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ceb6e2-6da8-40c8-bae0-3a822433ed82 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:07.541275 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ceb6e2-6da8-40c8-bae0-3a822433ed82 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:07.541539 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ceb6e2-6da8-40c8-bae0-3a822433ed82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:07.555119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ceb6e2-6da8-40c8-bae0-3a822433ed82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:08:07.559928 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-e4ceb6e2-6da8-40c8-bae0-3a822433ed82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:08:07.559928 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:07.559928 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:07.559928 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:07.559928 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:07.559928 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:07.559928 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:07.559928 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:07.559928 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:07.559928 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:07.559928 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:07.559928 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:07.559928 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:08:07.559928 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:08:07.559928 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:08:07.559928 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:08:07.560982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:08:07.560982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:08:07.560982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:08:07.560982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:08:07.560982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:07.560982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:07.560982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:07.560982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:07.560982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:07.560982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:07.560982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:07.560982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:07.560982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:07.560982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:07.560982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:07.560982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:07.562228 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:07.562228 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:07.562228 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:07.562228 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:07.562228 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:08:07.562228 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:08:07.562228 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:08:07.562228 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:08:07.562228 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:08:07.562228 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:08:07.562228 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:08:07.562228 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:08:07.562228 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 430/884] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 15:08:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:07.567325 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035b607-ac92-4590-b5da-4270be736815 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:07.584389 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:07.679582 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035b607-ac92-4590-b5da-4270be736815 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:07.713392 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e768bd-2283-45dc-9dff-7e6a5e560891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:07.714019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e768bd-2283-45dc-9dff-7e6a5e560891 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:07.714292 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e768bd-2283-45dc-9dff-7e6a5e560891 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:07.714554 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e768bd-2283-45dc-9dff-7e6a5e560891 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:07.715205 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e768bd-2283-45dc-9dff-7e6a5e560891 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:07.715494 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e768bd-2283-45dc-9dff-7e6a5e560891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:07.716864 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e768bd-2283-45dc-9dff-7e6a5e560891 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:07.727075 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 455/885] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:08:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:07.740319 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ceb6e2-6da8-40c8-bae0-3a822433ed82 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:07.815514 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:07.855132 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ceb6e2-6da8-40c8-bae0-3a822433ed82 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:07.903415 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19209e75-5375-477e-97bf-2175ac4b362b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:07.904068 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19209e75-5375-477e-97bf-2175ac4b362b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:07.904394 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19209e75-5375-477e-97bf-2175ac4b362b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:07.904666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19209e75-5375-477e-97bf-2175ac4b362b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:07.915807 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19209e75-5375-477e-97bf-2175ac4b362b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:07.917245 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19209e75-5375-477e-97bf-2175ac4b362b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:07.931884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-19209e75-5375-477e-97bf-2175ac4b362b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:08:07.931884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:07.931884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:07.931884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:07.931884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:07.931884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:07.931884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:07.931884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:07.931884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:07.931884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:07.931884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:07.931884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:07.931884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:08:07.931884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:08:07.931884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:08:07.931884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:08:07.932961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:07.932961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:07.932961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:07.932961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:07.932961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:07.932961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:07.932961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:07.932961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:07.932961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:07.932961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:07.932961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:07.932961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:07.932961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:07.932961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:07.932961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:07.932961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:07.932961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:08:07.933939 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:08:07.933939 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:08:07.933939 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:08:07.933939 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 431/886] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:07.940969 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e768bd-2283-45dc-9dff-7e6a5e560891 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:08.019346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:08.045899 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e768bd-2283-45dc-9dff-7e6a5e560891 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:08.080429 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a133d0a-9b85-42fc-a0ef-b81cbf42c2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:08.081019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a133d0a-9b85-42fc-a0ef-b81cbf42c2f5 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:08.081295 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a133d0a-9b85-42fc-a0ef-b81cbf42c2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:08.081561 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a133d0a-9b85-42fc-a0ef-b81cbf42c2f5 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:08.082222 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a133d0a-9b85-42fc-a0ef-b81cbf42c2f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:08.082526 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a133d0a-9b85-42fc-a0ef-b81cbf42c2f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:08.083955 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a133d0a-9b85-42fc-a0ef-b81cbf42c2f5 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:08.096756 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 456/887] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:08:08.102773 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19209e75-5375-477e-97bf-2175ac4b362b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:08.207918 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19209e75-5375-477e-97bf-2175ac4b362b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:08.227339 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:08.243402 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0c2c7-d99e-4cff-bef8-1e39c6cb2c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:08.244087 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0c2c7-d99e-4cff-bef8-1e39c6cb2c3a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:08.244405 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0c2c7-d99e-4cff-bef8-1e39c6cb2c3a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:08.244715 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0c2c7-d99e-4cff-bef8-1e39c6cb2c3a None admin] PATH_INFO: `/v3/users/placement` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:08.253002 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0c2c7-d99e-4cff-bef8-1e39c6cb2c3a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:08.254645 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0c2c7-d99e-4cff-bef8-1e39c6cb2c3a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:08.266778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-d4b0c2c7-d99e-4cff-bef8-1e39c6cb2c3a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:08:08.266778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:08.266778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:08.266778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:08.266778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:08.266778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:08.266778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:08.266778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:08.266778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:08.266778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:08.266778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:08.266778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:08.266778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:08:08.266778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:08:08.266778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:08:08.266778 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:08:08.267874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:08.267874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:08.267874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:08:08.267874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:08:08.267874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:08:08.267874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:08:08.267874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:08.267874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:08.267874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:08.267874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:08.267874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:08.267874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:08.267874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:08.267874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:08.267874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:08.267874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:08.267874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:08.267874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:08.268835 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:08.268835 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:08.268835 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:08:08.268835 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:08:08.268835 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:08:08.268835 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:08:08.268835 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:08:08.268835 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:08:08.268835 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:08:08.268835 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:08:08.268835 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 432/888] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:08:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:08.274315 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a133d0a-9b85-42fc-a0ef-b81cbf42c2f5 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:08.386410 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a133d0a-9b85-42fc-a0ef-b81cbf42c2f5 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:08.423554 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10621d-89e8-461b-aea3-22272c599e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:08.424184 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10621d-89e8-461b-aea3-22272c599e72 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:08.424457 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10621d-89e8-461b-aea3-22272c599e72 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:08.424726 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10621d-89e8-461b-aea3-22272c599e72 None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:08.425440 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10621d-89e8-461b-aea3-22272c599e72 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:08.425738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10621d-89e8-461b-aea3-22272c599e72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:08.427189 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10621d-89e8-461b-aea3-22272c599e72 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:08.429797 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:08.444774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 457/889] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Sep 23 15:08:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:08.451353 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0c2c7-d99e-4cff-bef8-1e39c6cb2c3a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:08.563655 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0c2c7-d99e-4cff-bef8-1e39c6cb2c3a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:08.598278 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465347e-ab53-46cc-b595-cf5755e0a5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:08.598883 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465347e-ab53-46cc-b595-cf5755e0a5f8 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:08.599152 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465347e-ab53-46cc-b595-cf5755e0a5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:08.599416 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465347e-ab53-46cc-b595-cf5755e0a5f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:08.610465 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465347e-ab53-46cc-b595-cf5755e0a5f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:08.611897 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465347e-ab53-46cc-b595-cf5755e0a5f8 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:08.625989 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-f465347e-ab53-46cc-b595-cf5755e0a5f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:08:08.625989 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:08.625989 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:08.625989 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:08.625989 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:08.625989 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:08.625989 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:08.625989 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:08.625989 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:08.625989 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:08.625989 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:08.625989 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:08.625989 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:08:08.625989 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:08:08.625989 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:08:08.625989 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:08:08.627069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:08.627069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:08.627069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:08.627069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:08.627069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:08.627069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:08.627069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:08.627069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:08.627069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:08.627069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:08.627069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:08.627069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:08.627069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:08.627069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:08.627069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:08.627069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:08.627069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:08:08.628783 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:08:08.628783 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:08:08.628783 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:08:08.628783 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 433/890] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:08.634106 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10621d-89e8-461b-aea3-22272c599e72 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:08.736625 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10621d-89e8-461b-aea3-22272c599e72 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:08.770846 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9b98a-766d-47af-b06b-95e02e4e3276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:08.771516 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9b98a-766d-47af-b06b-95e02e4e3276 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:08.771789 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9b98a-766d-47af-b06b-95e02e4e3276 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:08.772050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9b98a-766d-47af-b06b-95e02e4e3276 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:08.772670 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9b98a-766d-47af-b06b-95e02e4e3276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:08.772963 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9b98a-766d-47af-b06b-95e02e4e3276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:08.774350 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9b98a-766d-47af-b06b-95e02e4e3276 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:08.785274 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 458/891] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:08.791836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465347e-ab53-46cc-b595-cf5755e0a5f8 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:08.829069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:08.904644 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465347e-ab53-46cc-b595-cf5755e0a5f8 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:08.939889 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790af57-75f0-4f82-a381-2bb50cec215f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:08.940498 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790af57-75f0-4f82-a381-2bb50cec215f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:08.940764 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790af57-75f0-4f82-a381-2bb50cec215f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:08.941027 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790af57-75f0-4f82-a381-2bb50cec215f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:08.948378 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790af57-75f0-4f82-a381-2bb50cec215f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:08.949836 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790af57-75f0-4f82-a381-2bb50cec215f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:08.964381 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-a790af57-75f0-4f82-a381-2bb50cec215f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:08:08.964381 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:08.964381 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:08.964381 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:08.964381 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:08.964381 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:08.964381 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:08.964381 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:08.964381 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:08.964381 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:08.964381 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:08.964381 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:08.964381 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:08:08.964381 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:08:08.964381 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:08:08.965443 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:08:08.965443 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:08.965443 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:08.965443 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:08.965443 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:08.965443 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:08.965443 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:08.965443 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:08.965443 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:08.965443 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:08.965443 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:08.965443 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:08.965443 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:08.965443 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:08.965443 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:08.965443 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:08.965443 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:08.966550 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:08:08.966550 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:08:08.966550 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:08:08.966550 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:08:08.966550 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:08:08.966550 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:08:08.966550 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:08:08.966550 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:08:08.966550 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 434/892] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:08:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:08.971450 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9b98a-766d-47af-b06b-95e02e4e3276 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:09.028062 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:09.081444 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9b98a-766d-47af-b06b-95e02e4e3276 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:09.119822 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8baaaa-5fa2-4f89-9714-be0ddce71438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:09.120411 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8baaaa-5fa2-4f89-9714-be0ddce71438 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:09.120682 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8baaaa-5fa2-4f89-9714-be0ddce71438 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:09.120947 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8baaaa-5fa2-4f89-9714-be0ddce71438 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:09.121621 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8baaaa-5fa2-4f89-9714-be0ddce71438 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:09.121946 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8baaaa-5fa2-4f89-9714-be0ddce71438 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:09.123358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8baaaa-5fa2-4f89-9714-be0ddce71438 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:09.135166 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 459/893] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 15:08:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:08:09.141436 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790af57-75f0-4f82-a381-2bb50cec215f None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:09.235277 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:09.244391 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790af57-75f0-4f82-a381-2bb50cec215f None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:09.278228 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaafa5-3412-4030-9c13-7d9921a325d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:09.278863 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaafa5-3412-4030-9c13-7d9921a325d7 None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:09.279132 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaafa5-3412-4030-9c13-7d9921a325d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:09.279392 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaafa5-3412-4030-9c13-7d9921a325d7 None admin] PATH_INFO: `/v3/projects/1fd85e9620ea42a69363d006d715ad04/users/1d4347073208466b885d960d92bdbc77/roles/07d4069c848d4ee9abb586256ee26f20` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:09.281353 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aaafa5-3412-4030-9c13-7d9921a325d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fd85e9620ea42a69363d006d715ad04, user_id=1d4347073208466b885d960d92bdbc77, role_id=07d4069c848d4ee9abb586256ee26f20)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:09.282925 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aaafa5-3412-4030-9c13-7d9921a325d7 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:09.297779 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 435/894] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 15:08:09 2022] PUT /identity/v3/projects/1fd85e9620ea42a69363d006d715ad04/users/1d4347073208466b885d960d92bdbc77/roles/07d4069c848d4ee9abb586256ee26f20 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:08:11.646939 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae523eb-b193-4242-991a-cf998bb55f29 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:11.647521 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae523eb-b193-4242-991a-cf998bb55f29 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:11.647521 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae523eb-b193-4242-991a-cf998bb55f29 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:11.648789 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 460/895] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:11.655136 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb41a43-83b8-425e-bf30-8ba70e9e0798 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:11.655850 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb41a43-83b8-425e-bf30-8ba70e9e0798 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:11.656027 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb41a43-83b8-425e-bf30-8ba70e9e0798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:11.677058 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-1cb41a43-83b8-425e-bf30-8ba70e9e0798 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:11.678374 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-1cb41a43-83b8-425e-bf30-8ba70e9e0798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:11.754190 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 436/896] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:11 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:08:12.083919 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae523eb-b193-4242-991a-cf998bb55f29 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:12.200358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae523eb-b193-4242-991a-cf998bb55f29 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:12.222262 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:12.245135 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6171720-2aa7-4196-b746-9c72a0c2b006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:12.245796 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6171720-2aa7-4196-b746-9c72a0c2b006 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:12.246072 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6171720-2aa7-4196-b746-9c72a0c2b006 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:12.246340 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6171720-2aa7-4196-b746-9c72a0c2b006 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:12.256398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6171720-2aa7-4196-b746-9c72a0c2b006 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:08:12.261375 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-f6171720-2aa7-4196-b746-9c72a0c2b006 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:08:12.261375 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:12.261375 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:12.261375 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:12.261375 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:12.261375 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:12.261375 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:12.261375 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:12.261375 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:12.261375 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:12.261375 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:12.261375 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:12.261375 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:08:12.261375 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:08:12.261375 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:08:12.261375 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:08:12.262508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:08:12.262508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:08:12.262508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:08:12.262508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:08:12.262508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:12.262508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:12.262508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:12.262508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:12.262508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:12.262508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:12.262508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:12.262508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:12.262508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:12.262508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:12.262508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:12.262508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:12.263358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:12.263358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:12.263358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:12.263358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:12.263358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:08:12.263358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:08:12.263358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:08:12.263358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:08:12.263358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:08:12.263358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:08:12.263358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:08:12.263358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:08:12.263358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 461/897] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 15:08:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:12.270745 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb41a43-83b8-425e-bf30-8ba70e9e0798 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:12.364759 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:12.389864 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb41a43-83b8-425e-bf30-8ba70e9e0798 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:12.431345 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68eb9b-7ddf-4532-a4a6-a6b14ef3ddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:12.431983 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68eb9b-7ddf-4532-a4a6-a6b14ef3ddee None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:12.432250 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68eb9b-7ddf-4532-a4a6-a6b14ef3ddee None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:12.432518 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68eb9b-7ddf-4532-a4a6-a6b14ef3ddee None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:12.433187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68eb9b-7ddf-4532-a4a6-a6b14ef3ddee None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:12.433612 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68eb9b-7ddf-4532-a4a6-a6b14ef3ddee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:12.434944 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68eb9b-7ddf-4532-a4a6-a6b14ef3ddee None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:12.443658 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 437/898] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 15:08:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:12.452139 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6171720-2aa7-4196-b746-9c72a0c2b006 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:12.562654 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6171720-2aa7-4196-b746-9c72a0c2b006 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:12.598959 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca7edc-fd2b-4753-8468-a49ba46d3e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:12.599597 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca7edc-fd2b-4753-8468-a49ba46d3e93 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:12.599869 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca7edc-fd2b-4753-8468-a49ba46d3e93 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:12.600133 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca7edc-fd2b-4753-8468-a49ba46d3e93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:12.610496 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca7edc-fd2b-4753-8468-a49ba46d3e93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:12.611934 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca7edc-fd2b-4753-8468-a49ba46d3e93 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:12.626398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-9cca7edc-fd2b-4753-8468-a49ba46d3e93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:08:12.626398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:12.626398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:12.626398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:12.626398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:12.626398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:12.626398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:12.626398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:12.626398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:12.626398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:12.626398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:12.626398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:12.626398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:08:12.626398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:08:12.626398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:08:12.626398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:08:12.627456 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:12.627456 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:12.627456 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:12.627456 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:12.627456 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:12.627456 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:12.627456 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:12.627456 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:12.627456 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:12.627456 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:12.627456 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:12.627456 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:12.627456 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:12.627456 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:12.627456 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:12.627456 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:12.627456 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:08:12.628554 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:08:12.628554 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:08:12.628554 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:08:12.629866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 462/899] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:12.633265 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68eb9b-7ddf-4532-a4a6-a6b14ef3ddee None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:12.738406 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68eb9b-7ddf-4532-a4a6-a6b14ef3ddee None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:12.772896 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef0d43-58fc-4e30-b5c2-1a7a58e4d5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:12.773491 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef0d43-58fc-4e30-b5c2-1a7a58e4d5e0 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:12.773799 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef0d43-58fc-4e30-b5c2-1a7a58e4d5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:12.774060 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef0d43-58fc-4e30-b5c2-1a7a58e4d5e0 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:12.774692 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef0d43-58fc-4e30-b5c2-1a7a58e4d5e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:12.774990 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef0d43-58fc-4e30-b5c2-1a7a58e4d5e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:12.776337 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef0d43-58fc-4e30-b5c2-1a7a58e4d5e0 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:12.787986 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 438/900] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:12.793810 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca7edc-fd2b-4753-8468-a49ba46d3e93 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:12.822345 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:12.897608 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca7edc-fd2b-4753-8468-a49ba46d3e93 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:12.932519 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77824f85-3a63-45ec-8662-ed35b9cc9a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:12.933135 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77824f85-3a63-45ec-8662-ed35b9cc9a07 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:12.933406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77824f85-3a63-45ec-8662-ed35b9cc9a07 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:12.933669 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77824f85-3a63-45ec-8662-ed35b9cc9a07 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:12.941134 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77824f85-3a63-45ec-8662-ed35b9cc9a07 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:12.942596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77824f85-3a63-45ec-8662-ed35b9cc9a07 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:12.953738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-77824f85-3a63-45ec-8662-ed35b9cc9a07 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:08:12.953738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:12.953738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:12.953738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:12.953738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:12.953738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:12.953738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:12.953738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:12.953738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:12.953738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:12.953738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:12.953738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:12.953738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:08:12.953738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:08:12.953738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:08:12.953738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:08:12.954807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:12.954807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:12.954807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:08:12.954807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:08:12.954807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:08:12.954807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:08:12.954807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:12.954807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:12.954807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:12.954807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:12.954807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:12.954807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:12.954807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:12.954807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:12.954807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:12.954807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:12.954807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:12.954807 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:12.955940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:12.955940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:12.955940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:08:12.955940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:08:12.955940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:08:12.955940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:08:12.955940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:08:12.955940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:08:12.955940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:08:12.955940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:08:12.957862 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 463/901] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:08:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:12.960567 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef0d43-58fc-4e30-b5c2-1a7a58e4d5e0 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:12.966120 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:13.064657 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef0d43-58fc-4e30-b5c2-1a7a58e4d5e0 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:13.098945 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b7005-e427-4ae0-99e8-93dce8f50010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:13.099592 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b7005-e427-4ae0-99e8-93dce8f50010 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:13.099865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b7005-e427-4ae0-99e8-93dce8f50010 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:13.100174 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b7005-e427-4ae0-99e8-93dce8f50010 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:13.100885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b7005-e427-4ae0-99e8-93dce8f50010 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:13.101186 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b7005-e427-4ae0-99e8-93dce8f50010 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:13.102651 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b7005-e427-4ae0-99e8-93dce8f50010 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:13.128108 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 439/902] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Sep 23 15:08:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:13.134682 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77824f85-3a63-45ec-8662-ed35b9cc9a07 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:13.229940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:13.249819 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77824f85-3a63-45ec-8662-ed35b9cc9a07 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:13.284857 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7690754-3b44-4a89-a648-934854a8fc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:13.285445 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7690754-3b44-4a89-a648-934854a8fc89 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:13.285741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7690754-3b44-4a89-a648-934854a8fc89 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:13.286011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7690754-3b44-4a89-a648-934854a8fc89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:13.355997 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7690754-3b44-4a89-a648-934854a8fc89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:13.357435 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7690754-3b44-4a89-a648-934854a8fc89 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:13.442023 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:13.459951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 464/903] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 15:08:13 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:08:13.466049 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b7005-e427-4ae0-99e8-93dce8f50010 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:13.532414 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:13.573812 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b7005-e427-4ae0-99e8-93dce8f50010 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:13.610657 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113eb316-67e1-4bda-b92a-a913b73149f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:13.611262 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113eb316-67e1-4bda-b92a-a913b73149f7 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:13.611529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113eb316-67e1-4bda-b92a-a913b73149f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:13.611791 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113eb316-67e1-4bda-b92a-a913b73149f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:13.622062 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113eb316-67e1-4bda-b92a-a913b73149f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:13.623492 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113eb316-67e1-4bda-b92a-a913b73149f7 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:13.638219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-113eb316-67e1-4bda-b92a-a913b73149f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:08:13.638219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:13.638219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:13.638219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:13.638219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:13.638219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:13.638219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:13.638219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:13.638219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:13.638219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:13.638219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:13.638219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:13.638219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:08:13.638219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:08:13.638219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:08:13.638219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:08:13.639332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:13.639332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:13.639332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:13.639332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:13.639332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:13.639332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:13.639332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:13.639332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:13.639332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:13.639332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:13.639332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:13.639332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:13.639332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:13.639332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:13.639332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:13.639332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:13.639332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:08:13.640496 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:08:13.640496 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:08:13.640496 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:08:13.640496 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 440/904] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:13.645209 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7690754-3b44-4a89-a648-934854a8fc89 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:13.749770 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7690754-3b44-4a89-a648-934854a8fc89 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:13.783459 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29aaa1-30b1-4c8b-a9b5-a3ee9fa5ba8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:13.783985 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29aaa1-30b1-4c8b-a9b5-a3ee9fa5ba8e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:13.784253 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29aaa1-30b1-4c8b-a9b5-a3ee9fa5ba8e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:13.784523 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29aaa1-30b1-4c8b-a9b5-a3ee9fa5ba8e None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:13.785147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29aaa1-30b1-4c8b-a9b5-a3ee9fa5ba8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:13.785437 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29aaa1-30b1-4c8b-a9b5-a3ee9fa5ba8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:13.786829 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29aaa1-30b1-4c8b-a9b5-a3ee9fa5ba8e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:13.797716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 465/905] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 15:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:08:13.806211 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113eb316-67e1-4bda-b92a-a913b73149f7 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:13.928710 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113eb316-67e1-4bda-b92a-a913b73149f7 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:13.942373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:13.964096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53e714-e627-42cb-8332-323073171439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:13.964712 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53e714-e627-42cb-8332-323073171439 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:13.964987 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53e714-e627-42cb-8332-323073171439 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:13.965255 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53e714-e627-42cb-8332-323073171439 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:13.972130 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53e714-e627-42cb-8332-323073171439 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:13.973560 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53e714-e627-42cb-8332-323073171439 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:13.985344 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-fb53e714-e627-42cb-8332-323073171439 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:08:13.985344 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:13.985344 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:13.985344 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:13.985344 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:13.985344 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:13.985344 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:13.985344 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:13.985344 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:13.985344 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:13.985344 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:13.985344 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:13.985344 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:08:13.985344 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:08:13.985344 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:08:13.986353 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:08:13.986353 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:13.986353 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:13.986353 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:13.986353 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:13.986353 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:13.986353 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:13.986353 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:13.986353 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:13.986353 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:13.986353 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:13.986353 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:13.986353 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:13.986353 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:13.986353 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:13.986353 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:13.986353 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:13.987327 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:08:13.987327 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:08:13.987327 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:08:13.987327 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:08:13.987327 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:08:13.987327 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:08:13.987327 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:08:13.987327 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Sep 23 15:08:13.987327 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 441/906] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 15:08:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:08:13.993003 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29aaa1-30b1-4c8b-a9b5-a3ee9fa5ba8e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:14.051677 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:14.108538 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29aaa1-30b1-4c8b-a9b5-a3ee9fa5ba8e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:14.143146 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5787a1-509d-44ef-9053-6d3b0305ee56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:14.143754 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5787a1-509d-44ef-9053-6d3b0305ee56 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:14.144028 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5787a1-509d-44ef-9053-6d3b0305ee56 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:14.144298 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5787a1-509d-44ef-9053-6d3b0305ee56 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:14.145019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5787a1-509d-44ef-9053-6d3b0305ee56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:14.145319 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5787a1-509d-44ef-9053-6d3b0305ee56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:14.146961 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5787a1-509d-44ef-9053-6d3b0305ee56 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:14.158716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 466/907] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 15:08:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:14.165557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53e714-e627-42cb-8332-323073171439 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:14.280426 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53e714-e627-42cb-8332-323073171439 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:14.317381 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e908c-2563-4d8d-8863-eff713e29752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:14.317996 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e908c-2563-4d8d-8863-eff713e29752 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:14.318267 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e908c-2563-4d8d-8863-eff713e29752 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:14.318533 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e908c-2563-4d8d-8863-eff713e29752 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:14.319293 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e908c-2563-4d8d-8863-eff713e29752 None admin] RBAC: Adding query filter params (role.id=07d4069c848d4ee9abb586256ee26f20, scope.project.id=1fd85e9620ea42a69363d006d715ad04, user.id=1d4347073208466b885d960d92bdbc77) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:14.319596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e908c-2563-4d8d-8863-eff713e29752 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:14.321020 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e908c-2563-4d8d-8863-eff713e29752 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:14.326922 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 442/908] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 15:08:14 2022] GET /identity/v3/role_assignments?user.id=1d4347073208466b885d960d92bdbc77&scope.project.id=1fd85e9620ea42a69363d006d715ad04&role.id=07d4069c848d4ee9abb586256ee26f20 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:16.779113 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b0f72-5a95-405b-8833-ef0821769225 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:16.779640 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b0f72-5a95-405b-8833-ef0821769225 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:16.779640 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b0f72-5a95-405b-8833-ef0821769225 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:16.781729 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 467/909] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:08:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:16.787958 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33f279-798a-4485-9388-bbae41bd05f8 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:16.788369 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33f279-798a-4485-9388-bbae41bd05f8 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:16.788580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33f279-798a-4485-9388-bbae41bd05f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:16.812917 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-ea33f279-798a-4485-9388-bbae41bd05f8 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:16.814150 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-ea33f279-798a-4485-9388-bbae41bd05f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:16.845252 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:16.892745 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 443/910] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:16 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:08:17.210406 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b0f72-5a95-405b-8833-ef0821769225 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:17.323399 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b0f72-5a95-405b-8833-ef0821769225 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:17.330494 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:17.358161 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec943fb-1889-4595-a249-793a3b9b8706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:17.358773 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec943fb-1889-4595-a249-793a3b9b8706 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:17.359044 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec943fb-1889-4595-a249-793a3b9b8706 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:17.359310 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec943fb-1889-4595-a249-793a3b9b8706 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:17.359885 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec943fb-1889-4595-a249-793a3b9b8706 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:17.361254 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec943fb-1889-4595-a249-793a3b9b8706 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:17.370181 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-eec943fb-1889-4595-a249-793a3b9b8706 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 15:08:17.370181 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:17.370181 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:08:17.370181 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:08:17.370181 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:08:17.370181 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:08:17.370181 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:08:17.370181 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:08:17.370181 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 15:08:17.370181 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:08:17.370181 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:08:17.370181 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:08:17.370181 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:17.370181 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:17.370181 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:17.370181 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:17.370181 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:17.371347 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:17.371347 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:17.371347 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:17.371347 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:17.371347 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:17.371347 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:17.371347 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:08:17.371347 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:08:17.371347 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:08:17.371347 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:08:17.371347 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:17.371347 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:17.371347 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:17.371347 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:17.371347 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:17.371347 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:17.374774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:17.374774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:17.374774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:17.374774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:17.374774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:17.374774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:17.374774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:17.374774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:17.374774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:17.374774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:17.374774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:08:17.374774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:08:17.374774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 15:08:17.374774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:08:17.374774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 468/911] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Sep 23 15:08:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:17.379869 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33f279-798a-4485-9388-bbae41bd05f8 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:17.505782 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33f279-798a-4485-9388-bbae41bd05f8 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:17.547693 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1c8fc-c5b9-4422-ab51-db0e109f71dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:17.548300 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1c8fc-c5b9-4422-ab51-db0e109f71dd None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:17.548577 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1c8fc-c5b9-4422-ab51-db0e109f71dd None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:17.548851 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1c8fc-c5b9-4422-ab51-db0e109f71dd None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:17.549482 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1c8fc-c5b9-4422-ab51-db0e109f71dd None admin] RBAC: Adding query filter params (name=placement) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:17.549805 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1c8fc-c5b9-4422-ab51-db0e109f71dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:17.551177 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1c8fc-c5b9-4422-ab51-db0e109f71dd None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:17.556130 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 444/912] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Sep 23 15:08:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:17.565487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec943fb-1889-4595-a249-793a3b9b8706 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:17.670073 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec943fb-1889-4595-a249-793a3b9b8706 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:17.711767 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaf793-1f77-484b-b4dd-0d2466de636a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:17.712360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaf793-1f77-484b-b4dd-0d2466de636a None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:17.712628 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaf793-1f77-484b-b4dd-0d2466de636a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:17.712891 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaf793-1f77-484b-b4dd-0d2466de636a None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:17.713509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffaf793-1f77-484b-b4dd-0d2466de636a None admin] RBAC: Adding query filter params (type=placement) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:17.713834 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffaf793-1f77-484b-b4dd-0d2466de636a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:17.715200 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffaf793-1f77-484b-b4dd-0d2466de636a None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:17.722674 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 469/913] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Sep 23 15:08:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:20.069432 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcd56b-9168-40f8-bd01-e7b2923f1b05 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:20.070012 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcd56b-9168-40f8-bd01-e7b2923f1b05 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:20.070012 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcd56b-9168-40f8-bd01-e7b2923f1b05 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:20.072541 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 445/914] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:08:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:20.081937 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b365f-98e4-4901-be10-a453af014e93 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:20.082347 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b365f-98e4-4901-be10-a453af014e93 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:20.082500 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b365f-98e4-4901-be10-a453af014e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:20.108044 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-4a2b365f-98e4-4901-be10-a453af014e93 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:20.109221 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-4a2b365f-98e4-4901-be10-a453af014e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:20.135361 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:20.187889 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 470/915] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:20 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:08:20.504684 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcd56b-9168-40f8-bd01-e7b2923f1b05 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:20.547715 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:20.623758 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcd56b-9168-40f8-bd01-e7b2923f1b05 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:20.659676 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fcca6-ec58-4776-85fe-fd4428e3a290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:20.660275 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fcca6-ec58-4776-85fe-fd4428e3a290 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:20.660546 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fcca6-ec58-4776-85fe-fd4428e3a290 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:20.660814 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fcca6-ec58-4776-85fe-fd4428e3a290 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:20.661467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fcca6-ec58-4776-85fe-fd4428e3a290 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:20.662899 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fcca6-ec58-4776-85fe-fd4428e3a290 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:20.680188 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 446/916] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 15:08:20 2022] POST /identity/v3/services => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:08:23.038158 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50355ad-485c-4baf-b511-940d23d0528b None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:23.039022 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50355ad-485c-4baf-b511-940d23d0528b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:23.039022 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50355ad-485c-4baf-b511-940d23d0528b None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:23.041030 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 471/917] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:08:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:23.047368 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d9ed1-2ba2-4f13-b4db-b1a6de82ffdd None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:23.047826 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d9ed1-2ba2-4f13-b4db-b1a6de82ffdd None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:23.047928 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d9ed1-2ba2-4f13-b4db-b1a6de82ffdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:23.074199 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-250d9ed1-2ba2-4f13-b4db-b1a6de82ffdd None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:23.075374 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-250d9ed1-2ba2-4f13-b4db-b1a6de82ffdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:23.158248 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 447/918] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:23 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:08:23.471947 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50355ad-485c-4baf-b511-940d23d0528b None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:23.585105 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50355ad-485c-4baf-b511-940d23d0528b None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:23.620349 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc768072-495b-43d6-bd8a-f0ccc2df06d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:23.620958 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc768072-495b-43d6-bd8a-f0ccc2df06d4 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:23.621228 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc768072-495b-43d6-bd8a-f0ccc2df06d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:23.621497 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc768072-495b-43d6-bd8a-f0ccc2df06d4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:23.622098 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc768072-495b-43d6-bd8a-f0ccc2df06d4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:23.623450 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc768072-495b-43d6-bd8a-f0ccc2df06d4 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:23.632537 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-dc768072-495b-43d6-bd8a-f0ccc2df06d4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 15:08:23.632537 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:23.632537 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:08:23.632537 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:08:23.632537 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:08:23.632537 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:08:23.632537 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:08:23.632537 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:08:23.632537 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 15:08:23.632537 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:08:23.632537 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:08:23.632537 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:08:23.632537 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:23.632537 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:23.632537 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:23.632537 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:23.632537 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:23.633876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:23.633876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:23.633876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:23.633876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:23.633876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:23.633876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:23.633876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:08:23.633876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:08:23.633876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:08:23.633876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:08:23.633876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:23.633876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:23.633876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:23.633876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:23.633876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:23.633876 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:23.635710 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:23.635710 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:23.635710 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:23.635710 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:23.635710 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:23.635710 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:23.635710 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:23.635710 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:23.635710 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:23.635710 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:23.635710 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:08:23.635710 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:08:23.635710 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 15:08:23.635710 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:08:23.635710 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 472/919] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Sep 23 15:08:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:23.644089 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d9ed1-2ba2-4f13-b4db-b1a6de82ffdd None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:23.663923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:23.751254 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d9ed1-2ba2-4f13-b4db-b1a6de82ffdd None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:23.790410 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6ee7d-1d8c-4666-8ce1-6de6e1b0ecdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:23.791008 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6ee7d-1d8c-4666-8ce1-6de6e1b0ecdb None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:23.791277 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6ee7d-1d8c-4666-8ce1-6de6e1b0ecdb None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:23.791545 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6ee7d-1d8c-4666-8ce1-6de6e1b0ecdb None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:23.792168 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6ee7d-1d8c-4666-8ce1-6de6e1b0ecdb None admin] RBAC: Adding query filter params (name=placement) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:23.792466 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6ee7d-1d8c-4666-8ce1-6de6e1b0ecdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:23.793927 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6ee7d-1d8c-4666-8ce1-6de6e1b0ecdb None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:23.798914 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 448/920] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Sep 23 15:08:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:23.805711 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc768072-495b-43d6-bd8a-f0ccc2df06d4 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:23.838720 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:23.914938 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc768072-495b-43d6-bd8a-f0ccc2df06d4 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:23.948939 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d55538-cee8-4089-98aa-86d2e6acafd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:23.949527 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d55538-cee8-4089-98aa-86d2e6acafd8 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:23.949830 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d55538-cee8-4089-98aa-86d2e6acafd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:23.950102 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d55538-cee8-4089-98aa-86d2e6acafd8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:23.950783 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d55538-cee8-4089-98aa-86d2e6acafd8 None admin] RBAC: Adding query filter params (interface=public, service_id=950f3d3e0c9942728a3e3e2961dc0ea8, region_id=RegionOne) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:23.951087 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d55538-cee8-4089-98aa-86d2e6acafd8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:23.952447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d55538-cee8-4089-98aa-86d2e6acafd8 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:23.957415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 473/921] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Sep 23 15:08:23 2022] GET /identity/v3/endpoints?service_id=950f3d3e0c9942728a3e3e2961dc0ea8&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:23.963116 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6ee7d-1d8c-4666-8ce1-6de6e1b0ecdb None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:24.047757 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:24.073414 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6ee7d-1d8c-4666-8ce1-6de6e1b0ecdb None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:24.108376 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705f551-99a3-40b1-9004-7328602a0573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:24.108966 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705f551-99a3-40b1-9004-7328602a0573 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:24.109239 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705f551-99a3-40b1-9004-7328602a0573 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:24.109500 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705f551-99a3-40b1-9004-7328602a0573 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:24.110121 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705f551-99a3-40b1-9004-7328602a0573 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:24.111477 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705f551-99a3-40b1-9004-7328602a0573 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:24.118236 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 449/922] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Sep 23 15:08:23 2022] GET /identity/v3/services => generated 1962 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:08:26.479586 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69eeee-a4a7-4264-b6da-804124e73c6c None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:26.480145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69eeee-a4a7-4264-b6da-804124e73c6c None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:26.480145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69eeee-a4a7-4264-b6da-804124e73c6c None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:26.481448 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 474/923] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:26.487758 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488a25b-19a7-4ef5-9a87-45a76c8b3456 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:26.488468 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488a25b-19a7-4ef5-9a87-45a76c8b3456 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:26.488706 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488a25b-19a7-4ef5-9a87-45a76c8b3456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:26.510263 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-f488a25b-19a7-4ef5-9a87-45a76c8b3456 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:26.511425 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-f488a25b-19a7-4ef5-9a87-45a76c8b3456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:26.582634 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 450/924] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:26 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:08:26.899692 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69eeee-a4a7-4264-b6da-804124e73c6c None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:27.000132 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:27.010709 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69eeee-a4a7-4264-b6da-804124e73c6c None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:27.046582 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03628d67-e784-4faa-8541-c033cfd5fba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:27.047202 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03628d67-e784-4faa-8541-c033cfd5fba3 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:27.047475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03628d67-e784-4faa-8541-c033cfd5fba3 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:27.047717 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03628d67-e784-4faa-8541-c033cfd5fba3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:27.048288 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03628d67-e784-4faa-8541-c033cfd5fba3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:27.049653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03628d67-e784-4faa-8541-c033cfd5fba3 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:27.058404 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-03628d67-e784-4faa-8541-c033cfd5fba3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 15:08:27.058404 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:27.058404 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:08:27.058404 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:08:27.058404 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:08:27.058404 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:08:27.058404 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:08:27.058404 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:08:27.058404 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 15:08:27.058404 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:08:27.058404 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:08:27.058404 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:08:27.058404 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:27.058404 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:27.058404 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:27.058404 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:27.058404 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:27.059559 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:27.059559 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:27.059559 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:27.059559 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:27.059559 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:27.059559 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:27.059559 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:08:27.059559 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:08:27.059559 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:08:27.059559 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:08:27.059559 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:27.059559 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:27.059559 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:27.059559 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:27.059559 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:27.059559 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:27.060412 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:27.060412 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:27.060412 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:27.060412 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:27.060412 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:27.060412 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:27.060412 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:27.060412 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:27.060412 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:27.060412 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:27.060412 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:08:27.060412 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:08:27.060412 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 15:08:27.060412 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Sep 23 15:08:27.060412 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 475/925] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Sep 23 15:08:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:27.065916 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488a25b-19a7-4ef5-9a87-45a76c8b3456 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:27.145975 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:27.183232 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488a25b-19a7-4ef5-9a87-45a76c8b3456 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:27.217784 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24565d-6f0c-403b-b32e-97d0e9f262a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:27.218395 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24565d-6f0c-403b-b32e-97d0e9f262a3 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:27.218677 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24565d-6f0c-403b-b32e-97d0e9f262a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:27.218951 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24565d-6f0c-403b-b32e-97d0e9f262a3 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:27.219608 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24565d-6f0c-403b-b32e-97d0e9f262a3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:27.219912 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24565d-6f0c-403b-b32e-97d0e9f262a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:27.221326 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24565d-6f0c-403b-b32e-97d0e9f262a3 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:27.226395 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 451/926] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Sep 23 15:08:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:27.232668 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03628d67-e784-4faa-8541-c033cfd5fba3 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:27.335207 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03628d67-e784-4faa-8541-c033cfd5fba3 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:27.371063 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb982fe3-b82b-44d5-918e-ef2bf446e19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:27.371660 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb982fe3-b82b-44d5-918e-ef2bf446e19c None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:27.371936 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb982fe3-b82b-44d5-918e-ef2bf446e19c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:27.372206 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb982fe3-b82b-44d5-918e-ef2bf446e19c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:27.372866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb982fe3-b82b-44d5-918e-ef2bf446e19c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:27.374268 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb982fe3-b82b-44d5-918e-ef2bf446e19c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:27.397650 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 476/927] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 15:08:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:08:37.223441 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=30 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:37.393608 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:27.511108 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb435e-56bc-432b-a309-f031d8d3f060 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:27.513203 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb435e-56bc-432b-a309-f031d8d3f060 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:27.513203 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb435e-56bc-432b-a309-f031d8d3f060 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:27.514601 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 452/928] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:09:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:09:27.520089 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef5a63-afe6-4749-8d8a-310eb5b46b0c None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:27.520565 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef5a63-afe6-4749-8d8a-310eb5b46b0c None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:27.520720 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef5a63-afe6-4749-8d8a-310eb5b46b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:27.539907 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-9bef5a63-afe6-4749-8d8a-310eb5b46b0c None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:27.541104 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-9bef5a63-afe6-4749-8d8a-310eb5b46b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:27.622365 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 477/929] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:09:27.956545 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef466a-0847-4b8b-945e-ee5fd34f8252 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:27.956902 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef466a-0847-4b8b-945e-ee5fd34f8252 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:27.957253 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef466a-0847-4b8b-945e-ee5fd34f8252 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:27.959067 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 453/930] 10.222.0.48 () {54 vars in 964 bytes} [Fri Sep 23 15:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:27.965199 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485efb78-e764-4f5c-98b3-e20c7cea1ae4 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:27.965554 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485efb78-e764-4f5c-98b3-e20c7cea1ae4 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:27.965940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485efb78-e764-4f5c-98b3-e20c7cea1ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:28.032128 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-485efb78-e764-4f5c-98b3-e20c7cea1ae4 None None] MFA Rules not processed for user `8098c9c25a384b33885bbe6bcaaf01a8`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:28.033340 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-485efb78-e764-4f5c-98b3-e20c7cea1ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:28.100865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 478/931] 10.222.0.48 () {58 vars in 1061 bytes} [Fri Sep 23 15:09:27 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:09:28.110218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef466a-0847-4b8b-945e-ee5fd34f8252 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:28.122840 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef466a-0847-4b8b-945e-ee5fd34f8252 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:28.126607 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66080ff5-a0c9-4677-a7af-57de1e9def26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:28.127241 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66080ff5-a0c9-4677-a7af-57de1e9def26 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:28.127519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66080ff5-a0c9-4677-a7af-57de1e9def26 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:28.127789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66080ff5-a0c9-4677-a7af-57de1e9def26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:28.139410 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66080ff5-a0c9-4677-a7af-57de1e9def26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:28.141259 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66080ff5-a0c9-4677-a7af-57de1e9def26 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:28.169451 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 454/932] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:09:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:09:30.922652 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc1588-3747-420d-8cd1-19be6ab45279 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:30.923242 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc1588-3747-420d-8cd1-19be6ab45279 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:30.923242 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc1588-3747-420d-8cd1-19be6ab45279 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:30.924690 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 479/933] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:30.930031 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090baf9-b0ad-4e0a-b682-224149cfde3b None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:30.930462 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090baf9-b0ad-4e0a-b682-224149cfde3b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:30.930538 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090baf9-b0ad-4e0a-b682-224149cfde3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:30.951882 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-1090baf9-b0ad-4e0a-b682-224149cfde3b None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:30.953085 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-1090baf9-b0ad-4e0a-b682-224149cfde3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:30.961455 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 455/934] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:09:31.309934 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b7889-5f62-4497-b5ba-7e65b7da73c4 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:31.310291 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b7889-5f62-4497-b5ba-7e65b7da73c4 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:31.310638 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b7889-5f62-4497-b5ba-7e65b7da73c4 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:31.312243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 480/935] 10.222.0.48 () {54 vars in 964 bytes} [Fri Sep 23 15:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:31.318351 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec203c10-e25b-49a2-87ec-bbfe8c16972e None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:31.318638 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec203c10-e25b-49a2-87ec-bbfe8c16972e None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:31.318910 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec203c10-e25b-49a2-87ec-bbfe8c16972e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:31.338467 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-ec203c10-e25b-49a2-87ec-bbfe8c16972e None None] MFA Rules not processed for user `8098c9c25a384b33885bbe6bcaaf01a8`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:31.339590 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-ec203c10-e25b-49a2-87ec-bbfe8c16972e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:31.346479 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 456/936] 10.222.0.48 () {58 vars in 1061 bytes} [Fri Sep 23 15:09:31 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:09:31.355816 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b7889-5f62-4497-b5ba-7e65b7da73c4 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:31.367193 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b7889-5f62-4497-b5ba-7e65b7da73c4 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:31.370941 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cac212-eb03-41af-a4f2-2be3dbbb074c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:31.371482 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cac212-eb03-41af-a4f2-2be3dbbb074c service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:31.371763 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cac212-eb03-41af-a4f2-2be3dbbb074c service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:31.372039 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cac212-eb03-41af-a4f2-2be3dbbb074c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:31.382069 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cac212-eb03-41af-a4f2-2be3dbbb074c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:31.383505 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cac212-eb03-41af-a4f2-2be3dbbb074c service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:31.393413 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 481/937] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:09:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:09:34.297942 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5230c-58a1-41bf-9319-058bb6fd4a03 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:34.298424 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5230c-58a1-41bf-9319-058bb6fd4a03 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:34.298424 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5230c-58a1-41bf-9319-058bb6fd4a03 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:34.299793 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 457/938] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:34.305158 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e3290-74e7-49b4-973a-a7475138cd57 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:34.305587 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e3290-74e7-49b4-973a-a7475138cd57 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:34.305678 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e3290-74e7-49b4-973a-a7475138cd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:34.343909 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-054e3290-74e7-49b4-973a-a7475138cd57 None None] MFA Rules not processed for user `5b5fc9396faf4a98b542619453683e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:34.345068 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-054e3290-74e7-49b4-973a-a7475138cd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:34.389648 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:34.417097 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 482/939] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:34 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:09:34.747321 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5230c-58a1-41bf-9319-058bb6fd4a03 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:34.760087 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5230c-58a1-41bf-9319-058bb6fd4a03 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:34.764628 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1e3fa-7258-4984-90ea-a15756cd4e57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:34.765223 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1e3fa-7258-4984-90ea-a15756cd4e57 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:34.765496 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1e3fa-7258-4984-90ea-a15756cd4e57 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:34.765789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1e3fa-7258-4984-90ea-a15756cd4e57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:34.775224 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1e3fa-7258-4984-90ea-a15756cd4e57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:34.776642 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1e3fa-7258-4984-90ea-a15756cd4e57 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:34.785962 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 458/940] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:09:34 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:09:37.730720 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf150e-b192-49b6-9320-e3883bdfea8a None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:37.731187 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf150e-b192-49b6-9320-e3883bdfea8a None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:37.731281 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf150e-b192-49b6-9320-e3883bdfea8a None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:37.732605 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 483/941] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:37.739005 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5588bb3-cd07-437a-b5a9-2da692c69c2a None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:37.739480 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5588bb3-cd07-437a-b5a9-2da692c69c2a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:37.739583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5588bb3-cd07-437a-b5a9-2da692c69c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:37.765776 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-e5588bb3-cd07-437a-b5a9-2da692c69c2a None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:37.766907 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-e5588bb3-cd07-437a-b5a9-2da692c69c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:37.847369 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 459/942] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:37 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:09:38.197275 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf150e-b192-49b6-9320-e3883bdfea8a None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:38.213736 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf150e-b192-49b6-9320-e3883bdfea8a None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:38.218173 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb216171-992f-4fd1-ac16-aced4d80552d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:38.218763 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb216171-992f-4fd1-ac16-aced4d80552d service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:38.219038 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb216171-992f-4fd1-ac16-aced4d80552d service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:38.219302 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb216171-992f-4fd1-ac16-aced4d80552d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:38.229218 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb216171-992f-4fd1-ac16-aced4d80552d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:38.230682 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb216171-992f-4fd1-ac16-aced4d80552d service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:38.240653 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 484/943] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:09:38 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:09:41.264621 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd45c91-26dc-46e5-a628-ef66e313de31 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:41.265194 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd45c91-26dc-46e5-a628-ef66e313de31 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:41.265194 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd45c91-26dc-46e5-a628-ef66e313de31 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:41.266625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 460/944] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:41.272248 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9613e-7bf2-46d2-99ee-ea9a96fa9e08 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:41.272690 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9613e-7bf2-46d2-99ee-ea9a96fa9e08 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:41.272923 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9613e-7bf2-46d2-99ee-ea9a96fa9e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:41.295799 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-5ea9613e-7bf2-46d2-99ee-ea9a96fa9e08 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:41.297034 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-5ea9613e-7bf2-46d2-99ee-ea9a96fa9e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:41.306648 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 485/945] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:09:41.641415 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd45c91-26dc-46e5-a628-ef66e313de31 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:41.653290 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd45c91-26dc-46e5-a628-ef66e313de31 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:41.657168 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a41564-5aa5-45dd-a362-358e0b9eb5ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:41.657793 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a41564-5aa5-45dd-a362-358e0b9eb5ed service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:41.658065 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a41564-5aa5-45dd-a362-358e0b9eb5ed service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:41.658331 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a41564-5aa5-45dd-a362-358e0b9eb5ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:41.667678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a41564-5aa5-45dd-a362-358e0b9eb5ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:41.669107 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a41564-5aa5-45dd-a362-358e0b9eb5ed service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:41.678533 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 461/946] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:09:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:09:44.107307 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b29700-f9c8-4597-b349-049c6127cb57 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:44.107863 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b29700-f9c8-4597-b349-049c6127cb57 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:44.107863 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b29700-f9c8-4597-b349-049c6127cb57 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:44.109171 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 486/947] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:44.114709 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653f028-de43-4ec2-8cd4-4e4df29f9ecd None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:44.115176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653f028-de43-4ec2-8cd4-4e4df29f9ecd None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:44.115290 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653f028-de43-4ec2-8cd4-4e4df29f9ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:44.135129 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-d653f028-de43-4ec2-8cd4-4e4df29f9ecd None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:44.136315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-d653f028-de43-4ec2-8cd4-4e4df29f9ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:44.144582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 462/948] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:09:44.476216 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b29700-f9c8-4597-b349-049c6127cb57 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:44.487996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b29700-f9c8-4597-b349-049c6127cb57 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:44.491857 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56a3b7-51cf-40e8-b48b-61c48dba803b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:44.492449 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56a3b7-51cf-40e8-b48b-61c48dba803b service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:44.492727 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56a3b7-51cf-40e8-b48b-61c48dba803b service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:44.492996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56a3b7-51cf-40e8-b48b-61c48dba803b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:44.502252 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56a3b7-51cf-40e8-b48b-61c48dba803b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:44.503722 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56a3b7-51cf-40e8-b48b-61c48dba803b service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:44.513629 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 487/949] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:09:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:09:46.906006 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3b9b8-3365-46cd-9389-907e66254c05 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:46.906612 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3b9b8-3365-46cd-9389-907e66254c05 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:46.906612 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3b9b8-3365-46cd-9389-907e66254c05 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:46.907897 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 463/950] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:46.913376 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee91ecd-8dd2-4ef6-8da6-495622d74f3c None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:46.913822 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee91ecd-8dd2-4ef6-8da6-495622d74f3c None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:46.913933 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee91ecd-8dd2-4ef6-8da6-495622d74f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:46.934123 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-bee91ecd-8dd2-4ef6-8da6-495622d74f3c None None] MFA Rules not processed for user `5b5fc9396faf4a98b542619453683e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:46.935325 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-bee91ecd-8dd2-4ef6-8da6-495622d74f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:46.943810 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 488/951] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:46 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:09:47.271140 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3b9b8-3365-46cd-9389-907e66254c05 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:47.282399 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3b9b8-3365-46cd-9389-907e66254c05 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:47.286276 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0044b9-ec44-4c5f-8cb0-b83ca55a8df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:47.286866 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0044b9-ec44-4c5f-8cb0-b83ca55a8df7 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:47.287137 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0044b9-ec44-4c5f-8cb0-b83ca55a8df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:47.287406 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0044b9-ec44-4c5f-8cb0-b83ca55a8df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:47.296660 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0044b9-ec44-4c5f-8cb0-b83ca55a8df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:47.298117 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0044b9-ec44-4c5f-8cb0-b83ca55a8df7 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:47.307844 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 464/952] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:09:47 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:09:49.985806 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd780e-4024-4e37-a78e-f3ce6dc4c1a0 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:49.986348 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd780e-4024-4e37-a78e-f3ce6dc4c1a0 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:49.986348 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd780e-4024-4e37-a78e-f3ce6dc4c1a0 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:49.987877 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 489/953] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:49.993143 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b78491-9d3c-410b-bc58-3e11093ba039 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:49.993583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b78491-9d3c-410b-bc58-3e11093ba039 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:49.993682 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b78491-9d3c-410b-bc58-3e11093ba039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:50.014053 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-31b78491-9d3c-410b-bc58-3e11093ba039 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:50.015288 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-31b78491-9d3c-410b-bc58-3e11093ba039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:50.023923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 465/954] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:09:50.364959 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd780e-4024-4e37-a78e-f3ce6dc4c1a0 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:50.382001 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd780e-4024-4e37-a78e-f3ce6dc4c1a0 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:50.385856 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a893109-7806-4705-8bf2-7aee58485171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:50.386450 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a893109-7806-4705-8bf2-7aee58485171 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:50.386721 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a893109-7806-4705-8bf2-7aee58485171 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:50.387011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a893109-7806-4705-8bf2-7aee58485171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:50.396619 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a893109-7806-4705-8bf2-7aee58485171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:50.398127 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a893109-7806-4705-8bf2-7aee58485171 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:50.407879 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 490/955] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:09:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:09:52.846582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc13cf-a09e-48d8-b055-b39ed6bc78d9 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:52.847452 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc13cf-a09e-48d8-b055-b39ed6bc78d9 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:52.847452 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc13cf-a09e-48d8-b055-b39ed6bc78d9 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:52.849461 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 466/956] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:09:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:52.855132 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe90f6a-f106-487a-9a96-e1b0dfdc297f None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:52.855550 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe90f6a-f106-487a-9a96-e1b0dfdc297f None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:52.855661 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe90f6a-f106-487a-9a96-e1b0dfdc297f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:52.876313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-efe90f6a-f106-487a-9a96-e1b0dfdc297f None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:52.877401 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-efe90f6a-f106-487a-9a96-e1b0dfdc297f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:52.886035 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 491/957] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:09:53.219745 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc13cf-a09e-48d8-b055-b39ed6bc78d9 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:53.239804 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc13cf-a09e-48d8-b055-b39ed6bc78d9 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:53.244305 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124d316-f372-4ee1-9c13-f14949b1038f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:53.244902 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124d316-f372-4ee1-9c13-f14949b1038f service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:53.245176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124d316-f372-4ee1-9c13-f14949b1038f service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:53.245446 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124d316-f372-4ee1-9c13-f14949b1038f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:53.254984 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124d316-f372-4ee1-9c13-f14949b1038f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:53.256404 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124d316-f372-4ee1-9c13-f14949b1038f service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:53.265813 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 467/958] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:09:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:09:55.939995 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25cd3d-4f7b-4b75-a818-3d9c16ad4932 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:55.940570 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25cd3d-4f7b-4b75-a818-3d9c16ad4932 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:55.940570 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25cd3d-4f7b-4b75-a818-3d9c16ad4932 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:55.941818 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 492/959] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:55.948121 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a0098-fdb2-43cd-af29-5156e9356425 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:55.948810 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a0098-fdb2-43cd-af29-5156e9356425 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:55.948930 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a0098-fdb2-43cd-af29-5156e9356425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:55.978509 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-093a0098-fdb2-43cd-af29-5156e9356425 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:55.979708 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-093a0098-fdb2-43cd-af29-5156e9356425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:55.988700 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 468/960] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:55 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:09:56.335348 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25cd3d-4f7b-4b75-a818-3d9c16ad4932 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:56.347752 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25cd3d-4f7b-4b75-a818-3d9c16ad4932 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:56.351790 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55818225-3993-4492-88f6-44de907fb555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:56.352373 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55818225-3993-4492-88f6-44de907fb555 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:56.352649 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55818225-3993-4492-88f6-44de907fb555 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:56.353223 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55818225-3993-4492-88f6-44de907fb555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:56.361977 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55818225-3993-4492-88f6-44de907fb555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:56.363400 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55818225-3993-4492-88f6-44de907fb555 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:56.372438 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 493/961] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:09:56 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:10:00.687865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443f10e-6bd9-4395-9b32-6284466ae34b None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:00.688398 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443f10e-6bd9-4395-9b32-6284466ae34b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:00.688398 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443f10e-6bd9-4395-9b32-6284466ae34b None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:00.689952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 469/962] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:00.695065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd33d2-03a5-4e1b-b88a-12923fed107d None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:00.695501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd33d2-03a5-4e1b-b88a-12923fed107d None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:00.695590 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd33d2-03a5-4e1b-b88a-12923fed107d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:00.714864 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-cdbd33d2-03a5-4e1b-b88a-12923fed107d None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:00.716007 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-cdbd33d2-03a5-4e1b-b88a-12923fed107d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:00.725993 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 494/963] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:01.081117 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443f10e-6bd9-4395-9b32-6284466ae34b None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:01.086964 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=77 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:01.093903 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443f10e-6bd9-4395-9b32-6284466ae34b None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:01.098199 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501dd05-7686-4132-8128-750827ebaa27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:01.098925 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501dd05-7686-4132-8128-750827ebaa27 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:01.099197 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501dd05-7686-4132-8128-750827ebaa27 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:01.099458 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501dd05-7686-4132-8128-750827ebaa27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:01.108997 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501dd05-7686-4132-8128-750827ebaa27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:01.110457 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501dd05-7686-4132-8128-750827ebaa27 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:01.119761 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 470/964] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:10:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:10:04.165204 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c14ccf-5ca9-454b-8624-e7478f459e6b None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:04.165848 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c14ccf-5ca9-454b-8624-e7478f459e6b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:04.165848 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c14ccf-5ca9-454b-8624-e7478f459e6b None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:04.167059 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 495/965] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:04.172376 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad651a88-7e71-491b-8665-7b30cd74632b None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:04.172788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad651a88-7e71-491b-8665-7b30cd74632b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:04.172987 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad651a88-7e71-491b-8665-7b30cd74632b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:04.193072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-ad651a88-7e71-491b-8665-7b30cd74632b None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:04.194302 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-ad651a88-7e71-491b-8665-7b30cd74632b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:04.202933 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 471/966] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:04 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:04.571460 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c14ccf-5ca9-454b-8624-e7478f459e6b None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:04.577118 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=48 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:04.583586 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c14ccf-5ca9-454b-8624-e7478f459e6b None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:04.587219 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f7fcb-b9cd-44cc-b9c3-958ec5f3a864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:04.587821 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f7fcb-b9cd-44cc-b9c3-958ec5f3a864 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:04.588084 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f7fcb-b9cd-44cc-b9c3-958ec5f3a864 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:04.588343 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f7fcb-b9cd-44cc-b9c3-958ec5f3a864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:04.597241 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f7fcb-b9cd-44cc-b9c3-958ec5f3a864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:04.598794 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f7fcb-b9cd-44cc-b9c3-958ec5f3a864 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:04.608401 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 496/967] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:10:04 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:10:08.909530 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8286d6-26f1-4a8c-bfba-1752ca5004b1 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:08.910155 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8286d6-26f1-4a8c-bfba-1752ca5004b1 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:08.910155 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8286d6-26f1-4a8c-bfba-1752ca5004b1 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:08.911498 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 472/968] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:08.916821 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b62fe-2e80-4650-88fc-1f3340646415 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:08.917250 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b62fe-2e80-4650-88fc-1f3340646415 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:08.917449 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b62fe-2e80-4650-88fc-1f3340646415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:08.937564 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-439b62fe-2e80-4650-88fc-1f3340646415 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:08.938799 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-439b62fe-2e80-4650-88fc-1f3340646415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:08.947245 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 497/969] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:09.275942 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8286d6-26f1-4a8c-bfba-1752ca5004b1 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:09.288241 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8286d6-26f1-4a8c-bfba-1752ca5004b1 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:09.291957 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a101a-ae3a-4fb8-8ba1-9e48a754ae47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:09.292546 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a101a-ae3a-4fb8-8ba1-9e48a754ae47 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:09.292819 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a101a-ae3a-4fb8-8ba1-9e48a754ae47 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:09.293088 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a101a-ae3a-4fb8-8ba1-9e48a754ae47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:09.301970 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a101a-ae3a-4fb8-8ba1-9e48a754ae47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:09.303385 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a101a-ae3a-4fb8-8ba1-9e48a754ae47 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:09.312578 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 473/970] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:10:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:10:14.667877 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d9af7-87b5-4371-800f-b4f6ad593f93 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:14.668295 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d9af7-87b5-4371-800f-b4f6ad593f93 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:14.668459 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d9af7-87b5-4371-800f-b4f6ad593f93 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:14.669837 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 498/971] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 15:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:14.681543 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62d3dd-61b2-43cb-96a3-9242d718f3ff None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:14.682055 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62d3dd-61b2-43cb-96a3-9242d718f3ff None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:14.682139 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62d3dd-61b2-43cb-96a3-9242d718f3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:14.765932 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-8f62d3dd-61b2-43cb-96a3-9242d718f3ff None None] MFA Rules not processed for user `1d4347073208466b885d960d92bdbc77`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:14.767200 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-8f62d3dd-61b2-43cb-96a3-9242d718f3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:14.867741 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 474/972] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 15:10:14 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:18.932199 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=8 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:19.128372 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295d360-b1ae-4638-a380-cbbe817ce840 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:19.128714 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295d360-b1ae-4638-a380-cbbe817ce840 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:19.128941 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295d360-b1ae-4638-a380-cbbe817ce840 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:19.130659 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 499/973] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 15:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:19.135644 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7ccdb-0b58-43fa-a20c-508528e977c3 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:19.136477 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7ccdb-0b58-43fa-a20c-508528e977c3 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:19.136938 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7ccdb-0b58-43fa-a20c-508528e977c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:19.157342 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-dea7ccdb-0b58-43fa-a20c-508528e977c3 None None] MFA Rules not processed for user `1d4347073208466b885d960d92bdbc77`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:19.158823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-dea7ccdb-0b58-43fa-a20c-508528e977c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:19.168502 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 475/974] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 15:10:19 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:20.981304 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9beb1-4301-4592-93b1-fd376f16545f None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:20.981874 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9beb1-4301-4592-93b1-fd376f16545f None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:20.981961 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9beb1-4301-4592-93b1-fd376f16545f None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:20.983314 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 500/975] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 15:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:20.989163 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204617a-4ebf-4c5c-9579-df84e14eb575 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:20.989757 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204617a-4ebf-4c5c-9579-df84e14eb575 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:20.989757 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204617a-4ebf-4c5c-9579-df84e14eb575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:21.012201 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-1204617a-4ebf-4c5c-9579-df84e14eb575 None None] MFA Rules not processed for user `1d4347073208466b885d960d92bdbc77`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:21.013457 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-1204617a-4ebf-4c5c-9579-df84e14eb575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:21.023393 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 476/976] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 15:10:20 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:24.948497 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5323ad5-e37d-45a2-b395-5521f4ce5a53 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:24.949027 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5323ad5-e37d-45a2-b395-5521f4ce5a53 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:24.949270 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5323ad5-e37d-45a2-b395-5521f4ce5a53 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:24.950657 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 501/977] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:24.955903 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214339bb-dd1b-47a8-8980-2eb4ec99f249 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:24.956342 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214339bb-dd1b-47a8-8980-2eb4ec99f249 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:24.956441 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214339bb-dd1b-47a8-8980-2eb4ec99f249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:24.976814 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-214339bb-dd1b-47a8-8980-2eb4ec99f249 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:24.978335 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-214339bb-dd1b-47a8-8980-2eb4ec99f249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:24.986439 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 477/978] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:25.330437 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2ceb1-ca87-4a42-9cd1-10a17900f526 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:25.330721 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2ceb1-ca87-4a42-9cd1-10a17900f526 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:25.330992 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2ceb1-ca87-4a42-9cd1-10a17900f526 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:25.332295 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 502/979] 10.222.0.48 () {54 vars in 961 bytes} [Fri Sep 23 15:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:25.340100 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9e0b2-2603-4216-adb5-2e9e17384a41 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:25.340667 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9e0b2-2603-4216-adb5-2e9e17384a41 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:25.341163 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9e0b2-2603-4216-adb5-2e9e17384a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:25.387151 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-cbb9e0b2-2603-4216-adb5-2e9e17384a41 None None] MFA Rules not processed for user `542c7a84dd044588a42a9e3414cab516`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:25.388299 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-cbb9e0b2-2603-4216-adb5-2e9e17384a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:25.459081 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:25.465634 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 478/980] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Sep 23 15:10:25 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:25.473532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2ceb1-ca87-4a42-9cd1-10a17900f526 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:25.488459 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2ceb1-ca87-4a42-9cd1-10a17900f526 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:25.494034 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa1452-568a-4b8f-955d-7180b5b597ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:25.494655 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa1452-568a-4b8f-955d-7180b5b597ef service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:25.494926 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa1452-568a-4b8f-955d-7180b5b597ef service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:25.495195 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa1452-568a-4b8f-955d-7180b5b597ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:25.504592 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa1452-568a-4b8f-955d-7180b5b597ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:25.506253 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa1452-568a-4b8f-955d-7180b5b597ef service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:25.517397 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 503/981] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:10:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:10:28.105648 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ec191-ea80-4c38-a7a2-fe8d906ac0f7 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:28.106219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ec191-ea80-4c38-a7a2-fe8d906ac0f7 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:28.106219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ec191-ea80-4c38-a7a2-fe8d906ac0f7 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:28.110074 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 479/982] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:10:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:28.112740 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753165db-8dfd-4738-8885-e7eff7de206a None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:28.113194 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753165db-8dfd-4738-8885-e7eff7de206a None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:28.113288 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753165db-8dfd-4738-8885-e7eff7de206a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:28.138197 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-753165db-8dfd-4738-8885-e7eff7de206a None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:28.139658 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-753165db-8dfd-4738-8885-e7eff7de206a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:28.152208 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 504/983] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:28.493640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ec191-ea80-4c38-a7a2-fe8d906ac0f7 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:28.513766 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ec191-ea80-4c38-a7a2-fe8d906ac0f7 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:28.521672 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4196c68-ffbc-4b4a-bf8d-36cb1540a002 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:28.522658 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4196c68-ffbc-4b4a-bf8d-36cb1540a002 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:28.522658 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4196c68-ffbc-4b4a-bf8d-36cb1540a002 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:28.523176 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4196c68-ffbc-4b4a-bf8d-36cb1540a002 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:28.536142 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4196c68-ffbc-4b4a-bf8d-36cb1540a002 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:28.538672 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4196c68-ffbc-4b4a-bf8d-36cb1540a002 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:28.551891 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 480/984] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:10:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:10:31.253350 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6be83-14fa-4b40-b87c-8b5fbea9ca3c None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:31.253957 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6be83-14fa-4b40-b87c-8b5fbea9ca3c None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:31.253957 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6be83-14fa-4b40-b87c-8b5fbea9ca3c None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:31.255588 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 505/985] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:31.260995 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926e5d3-c447-4fca-bef3-99c2826b2861 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:31.261459 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926e5d3-c447-4fca-bef3-99c2826b2861 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:31.261556 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926e5d3-c447-4fca-bef3-99c2826b2861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:31.284644 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-7926e5d3-c447-4fca-bef3-99c2826b2861 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:31.285937 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-7926e5d3-c447-4fca-bef3-99c2826b2861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:31.295039 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 481/986] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:31.675001 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abd5bf-86fe-4b61-bc38-0fe81d4ab415 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:31.675280 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abd5bf-86fe-4b61-bc38-0fe81d4ab415 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:31.675770 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abd5bf-86fe-4b61-bc38-0fe81d4ab415 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:31.677130 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 506/987] 10.222.0.48 () {54 vars in 961 bytes} [Fri Sep 23 15:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:31.685091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf7fd3-f2a3-4357-91ff-30bdd49153ab None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:31.685369 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf7fd3-f2a3-4357-91ff-30bdd49153ab None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:31.685811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf7fd3-f2a3-4357-91ff-30bdd49153ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:31.706840 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-7aaf7fd3-f2a3-4357-91ff-30bdd49153ab None None] MFA Rules not processed for user `542c7a84dd044588a42a9e3414cab516`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:31.708576 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-7aaf7fd3-f2a3-4357-91ff-30bdd49153ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:31.725111 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 482/988] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Sep 23 15:10:31 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:10:31.726172 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abd5bf-86fe-4b61-bc38-0fe81d4ab415 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:31.751431 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abd5bf-86fe-4b61-bc38-0fe81d4ab415 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:31.756669 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1395d4d-db11-4784-aa89-28e96d687ed7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:31.757269 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1395d4d-db11-4784-aa89-28e96d687ed7 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:31.757544 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1395d4d-db11-4784-aa89-28e96d687ed7 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:31.757850 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1395d4d-db11-4784-aa89-28e96d687ed7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:31.767392 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1395d4d-db11-4784-aa89-28e96d687ed7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:31.769604 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1395d4d-db11-4784-aa89-28e96d687ed7 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:31.780717 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 507/989] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:10:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:10:34.301750 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8bd2f-b446-449d-9fe5-cb4f3b736507 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:34.302777 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8bd2f-b446-449d-9fe5-cb4f3b736507 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:34.303266 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8bd2f-b446-449d-9fe5-cb4f3b736507 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:34.310869 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df318bb1-ee9c-435f-98f1-f7c8be881b72 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:34.311882 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df318bb1-ee9c-435f-98f1-f7c8be881b72 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:34.312379 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df318bb1-ee9c-435f-98f1-f7c8be881b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:34.315734 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 483/990] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:10:34 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:34.334469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-df318bb1-ee9c-435f-98f1-f7c8be881b72 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:34.336102 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-df318bb1-ee9c-435f-98f1-f7c8be881b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:34.358178 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 508/991] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:10:34.688904 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8bd2f-b446-449d-9fe5-cb4f3b736507 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:34.709800 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8bd2f-b446-449d-9fe5-cb4f3b736507 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:34.716098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa0e48-cf30-4861-bc31-050a780aa52d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:34.717124 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa0e48-cf30-4861-bc31-050a780aa52d service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:34.717661 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa0e48-cf30-4861-bc31-050a780aa52d service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:34.718201 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa0e48-cf30-4861-bc31-050a780aa52d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:34.731848 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa0e48-cf30-4861-bc31-050a780aa52d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:34.735842 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa0e48-cf30-4861-bc31-050a780aa52d service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:34.756828 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 484/992] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:10:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:10:34.947942 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a1afd-1449-4f00-9d9a-6e8a65a91a64 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:34.948111 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a1afd-1449-4f00-9d9a-6e8a65a91a64 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:34.949150 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a1afd-1449-4f00-9d9a-6e8a65a91a64 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:34.958483 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 509/993] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:10:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:34.958937 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a52e1c-d128-4cd4-869d-c60dbdc9fb33 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:34.959283 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a52e1c-d128-4cd4-869d-c60dbdc9fb33 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:34.959470 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a52e1c-d128-4cd4-869d-c60dbdc9fb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:35.023868 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-a8a52e1c-d128-4cd4-869d-c60dbdc9fb33 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:35.030573 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-a8a52e1c-d128-4cd4-869d-c60dbdc9fb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:35.061855 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 485/994] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:35.450113 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3416ca-b6a0-4efe-99cf-b1373e951be6 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:35.450113 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3416ca-b6a0-4efe-99cf-b1373e951be6 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:35.450113 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3416ca-b6a0-4efe-99cf-b1373e951be6 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:35.452059 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 510/995] 10.222.0.48 () {54 vars in 963 bytes} [Fri Sep 23 15:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:35.456743 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acfe52-f197-4429-bcce-a8db07dda418 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:35.457244 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acfe52-f197-4429-bcce-a8db07dda418 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:35.457408 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acfe52-f197-4429-bcce-a8db07dda418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:35.495664 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-93acfe52-f197-4429-bcce-a8db07dda418 None None] MFA Rules not processed for user `0274d60e5bf14a4a9d3477e0efe31988`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:35.496944 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-93acfe52-f197-4429-bcce-a8db07dda418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:35.558950 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 486/996] 10.222.0.48 () {58 vars in 1060 bytes} [Fri Sep 23 15:10:35 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:35.567253 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3416ca-b6a0-4efe-99cf-b1373e951be6 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:35.579637 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3416ca-b6a0-4efe-99cf-b1373e951be6 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:35.584178 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcee75-0486-49e0-ad8d-aa0fce771155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0274d60e5bf14a4a9d3477e0efe31988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:35.584784 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcee75-0486-49e0-ad8d-aa0fce771155 service cinder] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:35.585088 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcee75-0486-49e0-ad8d-aa0fce771155 service cinder] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:35.585384 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcee75-0486-49e0-ad8d-aa0fce771155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:35.596069 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcee75-0486-49e0-ad8d-aa0fce771155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:35.597555 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcee75-0486-49e0-ad8d-aa0fce771155 service cinder] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:35.608663 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 511/997] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:10:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:10:37.268071 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5c67b-c76c-4e9c-b0ac-0c0be2e2f131 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:37.268645 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5c67b-c76c-4e9c-b0ac-0c0be2e2f131 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:37.268645 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5c67b-c76c-4e9c-b0ac-0c0be2e2f131 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:37.270058 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 487/998] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:37.275372 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed68b2-6eec-44ff-838a-e5a6adb02bca None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:37.275812 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed68b2-6eec-44ff-838a-e5a6adb02bca None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:37.275925 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed68b2-6eec-44ff-838a-e5a6adb02bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:37.294853 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-62ed68b2-6eec-44ff-838a-e5a6adb02bca None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:37.296028 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-62ed68b2-6eec-44ff-838a-e5a6adb02bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:37.304340 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 512/999] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:37.643461 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5c67b-c76c-4e9c-b0ac-0c0be2e2f131 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:37.657390 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5c67b-c76c-4e9c-b0ac-0c0be2e2f131 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:37.662464 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2303ea-904f-4baa-968f-25e1d598da54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:37.663066 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2303ea-904f-4baa-968f-25e1d598da54 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:37.663341 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2303ea-904f-4baa-968f-25e1d598da54 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:37.663614 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2303ea-904f-4baa-968f-25e1d598da54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:37.671918 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2303ea-904f-4baa-968f-25e1d598da54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:37.673827 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2303ea-904f-4baa-968f-25e1d598da54 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:37.683839 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 488/1000] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:10:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:10:40.141137 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6251a54-149c-4c1d-8334-0c5406a3e07f None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:40.142135 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6251a54-149c-4c1d-8334-0c5406a3e07f None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:40.142474 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6251a54-149c-4c1d-8334-0c5406a3e07f None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:40.144077 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 513/1001] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:10:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:40.149375 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbd044-90c2-4e78-b812-a93a9dfafa49 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:40.149814 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbd044-90c2-4e78-b812-a93a9dfafa49 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:40.150720 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbd044-90c2-4e78-b812-a93a9dfafa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:40.170869 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-95fbd044-90c2-4e78-b812-a93a9dfafa49 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:40.172044 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-95fbd044-90c2-4e78-b812-a93a9dfafa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:40.179873 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 489/1002] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:40.525096 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6251a54-149c-4c1d-8334-0c5406a3e07f None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:40.541516 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6251a54-149c-4c1d-8334-0c5406a3e07f None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:40.547819 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443fc57-90af-4366-b550-8d232c0c8b91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:40.548581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443fc57-90af-4366-b550-8d232c0c8b91 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:40.548918 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443fc57-90af-4366-b550-8d232c0c8b91 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:40.549250 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443fc57-90af-4366-b550-8d232c0c8b91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:40.559040 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443fc57-90af-4366-b550-8d232c0c8b91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:40.560676 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443fc57-90af-4366-b550-8d232c0c8b91 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:40.570333 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 514/1003] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:10:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:10:42.995748 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac2d9a-3301-459f-b1c0-7d321c2847ee None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:42.996326 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac2d9a-3301-459f-b1c0-7d321c2847ee None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:42.996326 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac2d9a-3301-459f-b1c0-7d321c2847ee None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:42.997599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 490/1004] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:43.003124 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3cfd7-c375-4da3-ab51-1812a4e84c96 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:43.003875 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3cfd7-c375-4da3-ab51-1812a4e84c96 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:43.004351 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3cfd7-c375-4da3-ab51-1812a4e84c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:43.024135 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-8aa3cfd7-c375-4da3-ab51-1812a4e84c96 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:43.025506 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-8aa3cfd7-c375-4da3-ab51-1812a4e84c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:43.034039 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 515/1005] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:43.377585 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac2d9a-3301-459f-b1c0-7d321c2847ee None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:43.392386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac2d9a-3301-459f-b1c0-7d321c2847ee None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:43.398948 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b88a0-078b-41d7-b35e-94ff1f3ab29c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:43.399547 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b88a0-078b-41d7-b35e-94ff1f3ab29c service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:43.399818 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b88a0-078b-41d7-b35e-94ff1f3ab29c service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:43.400083 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b88a0-078b-41d7-b35e-94ff1f3ab29c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:43.408811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b88a0-078b-41d7-b35e-94ff1f3ab29c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:43.411075 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b88a0-078b-41d7-b35e-94ff1f3ab29c service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:43.420627 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 491/1006] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:10:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:10:45.937906 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c48bda-d78a-4609-98af-aae248a5ceb0 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:45.957731 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c48bda-d78a-4609-98af-aae248a5ceb0 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:45.957731 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c48bda-d78a-4609-98af-aae248a5ceb0 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:45.957731 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 516/1007] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:45.958401 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10656044-5263-4cc4-85be-1107fdb25ead None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:45.958401 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10656044-5263-4cc4-85be-1107fdb25ead None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:45.958401 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10656044-5263-4cc4-85be-1107fdb25ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:45.965989 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-10656044-5263-4cc4-85be-1107fdb25ead None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:45.967163 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-10656044-5263-4cc4-85be-1107fdb25ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:45.974983 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 492/1008] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:46.311920 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c48bda-d78a-4609-98af-aae248a5ceb0 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:46.327644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c48bda-d78a-4609-98af-aae248a5ceb0 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:46.333136 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7140bb-c8b3-4b4f-8af7-48244ca56e01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:46.333761 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7140bb-c8b3-4b4f-8af7-48244ca56e01 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:46.334038 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7140bb-c8b3-4b4f-8af7-48244ca56e01 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:46.334308 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7140bb-c8b3-4b4f-8af7-48244ca56e01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:46.342427 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7140bb-c8b3-4b4f-8af7-48244ca56e01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:46.344007 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7140bb-c8b3-4b4f-8af7-48244ca56e01 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:46.354050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 517/1009] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:10:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:10:49.672466 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f645a-b27f-4350-a823-79473c2a37b6 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:49.673590 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f645a-b27f-4350-a823-79473c2a37b6 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:49.673590 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f645a-b27f-4350-a823-79473c2a37b6 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:49.674336 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 493/1010] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:49.679907 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cf207-c04f-44bb-b06f-1b27ac14727f None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:49.680438 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cf207-c04f-44bb-b06f-1b27ac14727f None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:49.680549 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cf207-c04f-44bb-b06f-1b27ac14727f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:49.688620 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=43 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:49.702487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-eb0cf207-c04f-44bb-b06f-1b27ac14727f None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:49.703732 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-eb0cf207-c04f-44bb-b06f-1b27ac14727f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:49.712452 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 518/1011] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:50.054864 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f645a-b27f-4350-a823-79473c2a37b6 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:50.069380 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f645a-b27f-4350-a823-79473c2a37b6 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:50.075024 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b4198-8639-4602-83e3-574902db9350 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:50.075624 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b4198-8639-4602-83e3-574902db9350 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:50.075900 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b4198-8639-4602-83e3-574902db9350 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:50.076172 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b4198-8639-4602-83e3-574902db9350 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:50.085126 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b4198-8639-4602-83e3-574902db9350 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:50.086735 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b4198-8639-4602-83e3-574902db9350 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:50.096364 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 494/1012] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:10:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:10:51.621296 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15747c-74e2-4b8a-b14e-81a9c489a4af None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:51.621932 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15747c-74e2-4b8a-b14e-81a9c489a4af None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:51.621932 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15747c-74e2-4b8a-b14e-81a9c489a4af None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:51.623292 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 519/1013] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:51.628583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30edd55-77fc-43d1-b9df-e3b7545d1643 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:51.629065 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30edd55-77fc-43d1-b9df-e3b7545d1643 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:51.629163 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30edd55-77fc-43d1-b9df-e3b7545d1643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:51.649170 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-f30edd55-77fc-43d1-b9df-e3b7545d1643 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:51.650545 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-f30edd55-77fc-43d1-b9df-e3b7545d1643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:51.659435 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 495/1014] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:52.018015 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542bb10-657c-417b-afe7-e43ae0995532 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:52.018302 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542bb10-657c-417b-afe7-e43ae0995532 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:52.018572 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542bb10-657c-417b-afe7-e43ae0995532 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:52.019933 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 520/1015] 10.222.0.48 () {54 vars in 962 bytes} [Fri Sep 23 15:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:52.025328 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11ae57-96c1-40eb-8d84-45b406fa47fb None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:52.025718 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11ae57-96c1-40eb-8d84-45b406fa47fb None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:52.026029 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11ae57-96c1-40eb-8d84-45b406fa47fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:52.066089 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-bf11ae57-96c1-40eb-8d84-45b406fa47fb None None] MFA Rules not processed for user `2f4a48b97bf9405eb44f593c41fe1e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:52.067342 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-bf11ae57-96c1-40eb-8d84-45b406fa47fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:52.093538 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:52.136388 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 496/1016] 10.222.0.48 () {58 vars in 1059 bytes} [Fri Sep 23 15:10:52 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:52.144264 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542bb10-657c-417b-afe7-e43ae0995532 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:52.155863 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542bb10-657c-417b-afe7-e43ae0995532 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:52.159985 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d9e8e-34b9-49b8-b316-900316cedb28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f4a48b97bf9405eb44f593c41fe1e4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:52.160796 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d9e8e-34b9-49b8-b316-900316cedb28 service glance] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:52.161065 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d9e8e-34b9-49b8-b316-900316cedb28 service glance] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:52.161455 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d9e8e-34b9-49b8-b316-900316cedb28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:52.170924 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d9e8e-34b9-49b8-b316-900316cedb28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:52.172422 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d9e8e-34b9-49b8-b316-900316cedb28 service glance] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:52.182333 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 521/1017] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:10:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:10:52.503128 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e00b5e-bb92-4545-81e3-544f1c8d7f3d None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:52.503442 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e00b5e-bb92-4545-81e3-544f1c8d7f3d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:52.503715 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e00b5e-bb92-4545-81e3-544f1c8d7f3d None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:52.505072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 497/1018] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:52.510565 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865cda6-b050-47eb-9435-823fe258055d None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:52.510853 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865cda6-b050-47eb-9435-823fe258055d None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:52.511122 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865cda6-b050-47eb-9435-823fe258055d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:52.533630 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-e865cda6-b050-47eb-9435-823fe258055d None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:52.534866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-e865cda6-b050-47eb-9435-823fe258055d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:52.543081 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 522/1019] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:52.891699 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e00b5e-bb92-4545-81e3-544f1c8d7f3d None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:52.909590 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e00b5e-bb92-4545-81e3-544f1c8d7f3d None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:52.916245 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aba260-4aa7-4060-b3e9-f42e34363e29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:52.916862 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aba260-4aa7-4060-b3e9-f42e34363e29 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:52.917138 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aba260-4aa7-4060-b3e9-f42e34363e29 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:52.917562 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aba260-4aa7-4060-b3e9-f42e34363e29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:52.930507 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aba260-4aa7-4060-b3e9-f42e34363e29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:52.932205 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aba260-4aa7-4060-b3e9-f42e34363e29 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:52.944288 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 498/1020] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:10:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:10:55.413147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be4ea8-102b-472b-9b6e-fb3ef3cf64d1 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:55.413899 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be4ea8-102b-472b-9b6e-fb3ef3cf64d1 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:55.413899 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be4ea8-102b-472b-9b6e-fb3ef3cf64d1 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:55.415087 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 523/1021] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:55.420771 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937e7b3-98c3-4eac-8992-44a988b2bd0f None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:55.421277 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937e7b3-98c3-4eac-8992-44a988b2bd0f None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:55.421277 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937e7b3-98c3-4eac-8992-44a988b2bd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:55.441834 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-c937e7b3-98c3-4eac-8992-44a988b2bd0f None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:55.443076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-c937e7b3-98c3-4eac-8992-44a988b2bd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:55.451450 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 499/1022] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:55.798614 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be4ea8-102b-472b-9b6e-fb3ef3cf64d1 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:55.813468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be4ea8-102b-472b-9b6e-fb3ef3cf64d1 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:55.819299 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8c522-de68-4587-a612-1e2e1b9eab80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:55.819910 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8c522-de68-4587-a612-1e2e1b9eab80 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:55.820181 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8c522-de68-4587-a612-1e2e1b9eab80 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:55.821809 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8c522-de68-4587-a612-1e2e1b9eab80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:55.830645 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8c522-de68-4587-a612-1e2e1b9eab80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:55.832244 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8c522-de68-4587-a612-1e2e1b9eab80 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:55.842984 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 524/1023] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:10:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:10:58.400218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427454f2-0d5a-4194-af8f-422ff029f060 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:58.400866 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427454f2-0d5a-4194-af8f-422ff029f060 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:58.400866 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427454f2-0d5a-4194-af8f-422ff029f060 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:58.402269 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 500/1024] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:58.411584 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6d965-a5ee-4610-96fc-c17e5e2cbc72 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:58.412161 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6d965-a5ee-4610-96fc-c17e5e2cbc72 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:58.412161 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6d965-a5ee-4610-96fc-c17e5e2cbc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:58.432347 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-12b6d965-a5ee-4610-96fc-c17e5e2cbc72 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:58.433531 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-12b6d965-a5ee-4610-96fc-c17e5e2cbc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:58.444249 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 525/1025] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:10:58.790741 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427454f2-0d5a-4194-af8f-422ff029f060 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:58.807888 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427454f2-0d5a-4194-af8f-422ff029f060 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:58.813401 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc84aa-33d4-44df-b6f7-e190a95baceb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:58.814077 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc84aa-33d4-44df-b6f7-e190a95baceb service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:58.814352 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc84aa-33d4-44df-b6f7-e190a95baceb service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:58.814591 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc84aa-33d4-44df-b6f7-e190a95baceb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:58.823866 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc84aa-33d4-44df-b6f7-e190a95baceb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:58.825520 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc84aa-33d4-44df-b6f7-e190a95baceb service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:58.837811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 501/1026] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:10:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:07.429713 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78871904-43a1-4e12-8d40-1fb150c82ebf None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:07.430353 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78871904-43a1-4e12-8d40-1fb150c82ebf None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:07.430353 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78871904-43a1-4e12-8d40-1fb150c82ebf None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:07.431586 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 526/1027] 10.222.0.48 () {54 vars in 918 bytes} [Fri Sep 23 15:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:07.436835 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35052f-b465-4470-aa71-92e947d61790 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:07.437298 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35052f-b465-4470-aa71-92e947d61790 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:07.437407 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35052f-b465-4470-aa71-92e947d61790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:07.458126 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-4c35052f-b465-4470-aa71-92e947d61790 None None] MFA Rules not processed for user `1d4347073208466b885d960d92bdbc77`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:07.459325 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-4c35052f-b465-4470-aa71-92e947d61790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:07.469493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 502/1028] 10.222.0.48 () {58 vars in 1015 bytes} [Fri Sep 23 15:11:07 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:11:07.484196 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ca8de-7238-4c34-8919-0e9a76a15d05 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:07.484425 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ca8de-7238-4c34-8919-0e9a76a15d05 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:07.484697 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ca8de-7238-4c34-8919-0e9a76a15d05 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:07.486039 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 527/1029] 10.222.0.48 () {54 vars in 918 bytes} [Fri Sep 23 15:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:07.490773 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71d1de-b864-493d-990b-bce366210043 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:07.491054 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71d1de-b864-493d-990b-bce366210043 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:07.491323 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71d1de-b864-493d-990b-bce366210043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:07.511723 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-8a71d1de-b864-493d-990b-bce366210043 None None] MFA Rules not processed for user `542c7a84dd044588a42a9e3414cab516`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:07.512897 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-8a71d1de-b864-493d-990b-bce366210043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:07.522781 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 503/1030] 10.222.0.48 () {58 vars in 1015 bytes} [Fri Sep 23 15:11:07 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:11:08.427014 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=20 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:10.314481 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392589f9-c6dc-4ba7-994f-c23cae638485 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:10.315589 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392589f9-c6dc-4ba7-994f-c23cae638485 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:10.315589 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392589f9-c6dc-4ba7-994f-c23cae638485 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:10.317439 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 528/1031] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:11:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:10.323919 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e74ac6-945e-4ca8-9646-991d5c79e41d None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:10.324662 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e74ac6-945e-4ca8-9646-991d5c79e41d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:10.324823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e74ac6-945e-4ca8-9646-991d5c79e41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:10.347990 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-42e74ac6-945e-4ca8-9646-991d5c79e41d None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:10.349203 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-42e74ac6-945e-4ca8-9646-991d5c79e41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:10.358667 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 504/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:11:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:11:10.699353 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392589f9-c6dc-4ba7-994f-c23cae638485 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:10.718856 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392589f9-c6dc-4ba7-994f-c23cae638485 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:10.724256 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074ec9d-4b1a-4700-b38f-b8bb8e0beed3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:10.725282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074ec9d-4b1a-4700-b38f-b8bb8e0beed3 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:10.725282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074ec9d-4b1a-4700-b38f-b8bb8e0beed3 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:10.725451 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074ec9d-4b1a-4700-b38f-b8bb8e0beed3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:10.734440 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074ec9d-4b1a-4700-b38f-b8bb8e0beed3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:10.736047 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074ec9d-4b1a-4700-b38f-b8bb8e0beed3 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:10.745537 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 529/1033] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:11:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:12.449407 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339daf66-dfc5-4605-b70d-34576a377c4b None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:12.450025 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339daf66-dfc5-4605-b70d-34576a377c4b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:12.450025 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339daf66-dfc5-4605-b70d-34576a377c4b None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:12.451344 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 505/1034] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:12.457506 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe1fe2-b52e-4ccb-afeb-34d62a706197 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:12.458331 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe1fe2-b52e-4ccb-afeb-34d62a706197 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:12.458458 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe1fe2-b52e-4ccb-afeb-34d62a706197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:12.486029 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-82fe1fe2-b52e-4ccb-afeb-34d62a706197 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:12.487217 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-82fe1fe2-b52e-4ccb-afeb-34d62a706197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:12.495871 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 530/1035] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:11:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:11:12.703469 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339daf66-dfc5-4605-b70d-34576a377c4b None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:12.719441 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339daf66-dfc5-4605-b70d-34576a377c4b None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:12.724495 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f8e23-4f1a-4fa5-8e31-0f21fa349904 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:12.725715 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f8e23-4f1a-4fa5-8e31-0f21fa349904 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:12.725715 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f8e23-4f1a-4fa5-8e31-0f21fa349904 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:12.725715 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f8e23-4f1a-4fa5-8e31-0f21fa349904 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:12.734969 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f8e23-4f1a-4fa5-8e31-0f21fa349904 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:12.736799 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f8e23-4f1a-4fa5-8e31-0f21fa349904 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:12.746952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 506/1036] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:11:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:14.450119 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04537fe0-56b2-4186-b61e-f14b47ac52f7 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:14.450682 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04537fe0-56b2-4186-b61e-f14b47ac52f7 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:14.450682 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04537fe0-56b2-4186-b61e-f14b47ac52f7 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:14.451974 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 531/1037] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:14.458127 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a182c5b-49b0-403e-afe0-c91206cb6672 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:14.458825 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a182c5b-49b0-403e-afe0-c91206cb6672 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:14.459010 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a182c5b-49b0-403e-afe0-c91206cb6672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:14.485139 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-9a182c5b-49b0-403e-afe0-c91206cb6672 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:14.486377 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-9a182c5b-49b0-403e-afe0-c91206cb6672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:14.495422 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 507/1038] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:11:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:11:14.653397 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04537fe0-56b2-4186-b61e-f14b47ac52f7 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:14.671060 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04537fe0-56b2-4186-b61e-f14b47ac52f7 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:14.677124 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a4711-6a58-47b6-b7c6-a28cd5031bbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:14.677751 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a4711-6a58-47b6-b7c6-a28cd5031bbf service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:14.678054 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a4711-6a58-47b6-b7c6-a28cd5031bbf service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:14.678319 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a4711-6a58-47b6-b7c6-a28cd5031bbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:14.686317 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a4711-6a58-47b6-b7c6-a28cd5031bbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:14.687886 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a4711-6a58-47b6-b7c6-a28cd5031bbf service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:14.697146 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 532/1039] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:11:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:16.355781 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d701653-7e74-41cd-81ef-8a46c2b0e49d None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:16.356389 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d701653-7e74-41cd-81ef-8a46c2b0e49d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:16.356389 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d701653-7e74-41cd-81ef-8a46c2b0e49d None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:16.357666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 508/1040] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:16.362756 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cf839-bd22-41f3-8420-99b0f30042d7 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:16.363313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cf839-bd22-41f3-8420-99b0f30042d7 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:16.363313 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cf839-bd22-41f3-8420-99b0f30042d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:16.384281 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-da7cf839-bd22-41f3-8420-99b0f30042d7 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:16.385532 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-da7cf839-bd22-41f3-8420-99b0f30042d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:16.393580 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 533/1041] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:11:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:11:16.560672 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d701653-7e74-41cd-81ef-8a46c2b0e49d None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:16.582838 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d701653-7e74-41cd-81ef-8a46c2b0e49d None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:16.588985 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fe84d-47ed-44e0-98d2-222241aee744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:16.589671 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fe84d-47ed-44e0-98d2-222241aee744 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:16.589986 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fe84d-47ed-44e0-98d2-222241aee744 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:16.590258 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fe84d-47ed-44e0-98d2-222241aee744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:16.599411 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fe84d-47ed-44e0-98d2-222241aee744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:16.601075 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fe84d-47ed-44e0-98d2-222241aee744 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:16.611430 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 509/1042] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:11:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:18.273248 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4ac6a-b487-4485-bbd0-e1ec982e66f7 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:18.274149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4ac6a-b487-4485-bbd0-e1ec982e66f7 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:18.274149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4ac6a-b487-4485-bbd0-e1ec982e66f7 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:18.276216 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 534/1043] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:11:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:18.281310 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968717d-340a-4526-b4e9-0f6cf06185b9 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:18.281753 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968717d-340a-4526-b4e9-0f6cf06185b9 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:18.281847 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968717d-340a-4526-b4e9-0f6cf06185b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:18.301945 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-3968717d-340a-4526-b4e9-0f6cf06185b9 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:18.303187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-3968717d-340a-4526-b4e9-0f6cf06185b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:18.311703 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 510/1044] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:11:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:11:18.466591 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4ac6a-b487-4485-bbd0-e1ec982e66f7 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:18.483468 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4ac6a-b487-4485-bbd0-e1ec982e66f7 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:18.489129 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259edd4-3c36-4edb-b663-86d093ed0f30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:18.489717 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259edd4-3c36-4edb-b663-86d093ed0f30 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:18.490018 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259edd4-3c36-4edb-b663-86d093ed0f30 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:18.490284 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259edd4-3c36-4edb-b663-86d093ed0f30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:18.498162 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259edd4-3c36-4edb-b663-86d093ed0f30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:18.499778 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259edd4-3c36-4edb-b663-86d093ed0f30 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:18.508776 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 535/1045] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:11:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:20.113184 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb109de-44b0-49eb-99c8-932f39053f52 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:20.113812 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb109de-44b0-49eb-99c8-932f39053f52 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:20.113812 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb109de-44b0-49eb-99c8-932f39053f52 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:20.115113 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 511/1046] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:20.121032 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512229f-6c7b-4c9f-a850-120def22d15d None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:20.121499 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512229f-6c7b-4c9f-a850-120def22d15d None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:20.121593 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512229f-6c7b-4c9f-a850-120def22d15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:20.150508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-e512229f-6c7b-4c9f-a850-120def22d15d None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:20.151816 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-e512229f-6c7b-4c9f-a850-120def22d15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:20.160774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 536/1047] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:11:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:11:20.319770 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb109de-44b0-49eb-99c8-932f39053f52 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:20.339076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb109de-44b0-49eb-99c8-932f39053f52 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:20.344291 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec550e-6ce4-43c4-a86c-8539ecd9d537 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:20.344885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec550e-6ce4-43c4-a86c-8539ecd9d537 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:20.345159 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec550e-6ce4-43c4-a86c-8539ecd9d537 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:20.345429 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec550e-6ce4-43c4-a86c-8539ecd9d537 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:20.354301 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec550e-6ce4-43c4-a86c-8539ecd9d537 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:20.356293 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec550e-6ce4-43c4-a86c-8539ecd9d537 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:20.366593 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 512/1048] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:11:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:22.071563 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f3868-05a7-4a48-9e5c-941840585e8c None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:22.072138 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f3868-05a7-4a48-9e5c-941840585e8c None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:22.072138 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f3868-05a7-4a48-9e5c-941840585e8c None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:22.074207 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 537/1049] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:11:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:22.082543 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e70cea-b1f2-47bd-b227-5e58b83a097c None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:22.082976 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e70cea-b1f2-47bd-b227-5e58b83a097c None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:22.083103 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e70cea-b1f2-47bd-b227-5e58b83a097c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:22.103798 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=66 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:22.109668 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-59e70cea-b1f2-47bd-b227-5e58b83a097c None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:22.110884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-59e70cea-b1f2-47bd-b227-5e58b83a097c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:22.119808 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 513/1050] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:11:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:11:22.278779 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f3868-05a7-4a48-9e5c-941840585e8c None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:22.298837 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f3868-05a7-4a48-9e5c-941840585e8c None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:22.304550 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e8bf4-5cd2-4287-8864-ba3dd9fa8ca5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:22.305151 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e8bf4-5cd2-4287-8864-ba3dd9fa8ca5 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:22.305428 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e8bf4-5cd2-4287-8864-ba3dd9fa8ca5 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:22.305720 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e8bf4-5cd2-4287-8864-ba3dd9fa8ca5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:22.313596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e8bf4-5cd2-4287-8864-ba3dd9fa8ca5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:22.315206 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e8bf4-5cd2-4287-8864-ba3dd9fa8ca5 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:22.324675 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 538/1051] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:11:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:23.900774 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d703d5c-10d6-4cb9-8c58-1531e19c44b8 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:23.901617 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d703d5c-10d6-4cb9-8c58-1531e19c44b8 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:23.901961 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d703d5c-10d6-4cb9-8c58-1531e19c44b8 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:23.904216 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 514/1052] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:11:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:23.911525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9df96-d2c4-4e19-b80c-bc3a5620b988 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:23.911991 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9df96-d2c4-4e19-b80c-bc3a5620b988 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:23.912093 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9df96-d2c4-4e19-b80c-bc3a5620b988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:23.932831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-93c9df96-d2c4-4e19-b80c-bc3a5620b988 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:23.934034 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-93c9df96-d2c4-4e19-b80c-bc3a5620b988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:23.942224 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 539/1053] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:11:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:11:24.099197 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d703d5c-10d6-4cb9-8c58-1531e19c44b8 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:24.121260 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d703d5c-10d6-4cb9-8c58-1531e19c44b8 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:24.129707 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef804339-c5e6-41f6-8e5d-9464c2b65d83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:24.130308 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef804339-c5e6-41f6-8e5d-9464c2b65d83 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:24.130580 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef804339-c5e6-41f6-8e5d-9464c2b65d83 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:24.130846 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef804339-c5e6-41f6-8e5d-9464c2b65d83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:24.139262 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef804339-c5e6-41f6-8e5d-9464c2b65d83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:24.140831 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef804339-c5e6-41f6-8e5d-9464c2b65d83 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:24.150895 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 515/1054] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:11:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:25.810344 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d9f2d-7639-4c1d-a66d-5bc692e76421 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:25.810951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d9f2d-7639-4c1d-a66d-5bc692e76421 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:25.810951 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d9f2d-7639-4c1d-a66d-5bc692e76421 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:25.812238 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 540/1055] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:25.819879 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c33c3-cd6c-4d6b-90d8-624ef854e66f None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:25.820335 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c33c3-cd6c-4d6b-90d8-624ef854e66f None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:25.820440 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c33c3-cd6c-4d6b-90d8-624ef854e66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:25.850370 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-c61c33c3-cd6c-4d6b-90d8-624ef854e66f None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:25.851875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-c61c33c3-cd6c-4d6b-90d8-624ef854e66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:25.860984 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 516/1056] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:11:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:11:26.023926 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d9f2d-7639-4c1d-a66d-5bc692e76421 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:26.045601 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d9f2d-7639-4c1d-a66d-5bc692e76421 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:26.053668 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae653e7-e56e-440c-92df-49bfe16eaf33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:26.054305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae653e7-e56e-440c-92df-49bfe16eaf33 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:26.054579 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae653e7-e56e-440c-92df-49bfe16eaf33 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:26.054867 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae653e7-e56e-440c-92df-49bfe16eaf33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:26.064340 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae653e7-e56e-440c-92df-49bfe16eaf33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:26.065957 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae653e7-e56e-440c-92df-49bfe16eaf33 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:26.075840 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 541/1057] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:11:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:28.354493 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2711c1-b970-47b4-83c3-670f29daf58a None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:28.355115 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2711c1-b970-47b4-83c3-670f29daf58a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:28.355115 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2711c1-b970-47b4-83c3-670f29daf58a None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:28.356384 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 517/1058] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:28.363309 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679f85b-66d4-448d-b8b6-dfc6d6206b84 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:28.363959 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679f85b-66d4-448d-b8b6-dfc6d6206b84 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:28.364109 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679f85b-66d4-448d-b8b6-dfc6d6206b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:28.386964 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-1679f85b-66d4-448d-b8b6-dfc6d6206b84 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:28.388199 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-1679f85b-66d4-448d-b8b6-dfc6d6206b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:28.398705 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 542/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:11:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:11:28.742963 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2711c1-b970-47b4-83c3-670f29daf58a None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:28.759051 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2711c1-b970-47b4-83c3-670f29daf58a None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:28.763351 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c4a9b-ffc4-4945-a862-313209f198fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:28.763955 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c4a9b-ffc4-4945-a862-313209f198fb service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:28.764234 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c4a9b-ffc4-4945-a862-313209f198fb service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:28.764508 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c4a9b-ffc4-4945-a862-313209f198fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:28.773922 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c4a9b-ffc4-4945-a862-313209f198fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:28.775369 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c4a9b-ffc4-4945-a862-313209f198fb service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:28.784912 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 518/1060] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:11:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:31.300942 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd526724-3a6f-453a-9a06-4cd2baa593e3 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:31.301865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd526724-3a6f-453a-9a06-4cd2baa593e3 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:31.301865 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd526724-3a6f-453a-9a06-4cd2baa593e3 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:31.303992 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 543/1061] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:11:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:31.309346 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d81e7-eb24-4b24-aa5b-a05dcfd6cd9e None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:31.309813 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d81e7-eb24-4b24-aa5b-a05dcfd6cd9e None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:31.309910 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d81e7-eb24-4b24-aa5b-a05dcfd6cd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:31.336597 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-d08d81e7-eb24-4b24-aa5b-a05dcfd6cd9e None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:31.337848 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-d08d81e7-eb24-4b24-aa5b-a05dcfd6cd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:31.346929 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 519/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:11:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:11:31.697141 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd526724-3a6f-453a-9a06-4cd2baa593e3 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:31.711441 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd526724-3a6f-453a-9a06-4cd2baa593e3 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:31.717154 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b87be0-c521-4f1b-a315-84a29a573f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:31.717774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b87be0-c521-4f1b-a315-84a29a573f41 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:31.718050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b87be0-c521-4f1b-a315-84a29a573f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:31.718310 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b87be0-c521-4f1b-a315-84a29a573f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:31.729079 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b87be0-c521-4f1b-a315-84a29a573f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:31.730538 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b87be0-c521-4f1b-a315-84a29a573f41 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:31.740001 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 544/1063] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:11:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:34.676265 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0d725-4f31-4ac6-bca4-ab4a524927e6 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:34.677184 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0d725-4f31-4ac6-bca4-ab4a524927e6 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:34.677184 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0d725-4f31-4ac6-bca4-ab4a524927e6 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:34.679402 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 520/1064] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:11:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:34.687714 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3125fef-acf9-4f1a-8eb5-8c1f4fbd50d0 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:34.688166 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3125fef-acf9-4f1a-8eb5-8c1f4fbd50d0 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:34.688261 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3125fef-acf9-4f1a-8eb5-8c1f4fbd50d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:34.708716 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-e3125fef-acf9-4f1a-8eb5-8c1f4fbd50d0 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:34.710044 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-e3125fef-acf9-4f1a-8eb5-8c1f4fbd50d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:34.720280 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 545/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:11:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:11:35.053161 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0d725-4f31-4ac6-bca4-ab4a524927e6 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:35.071098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0d725-4f31-4ac6-bca4-ab4a524927e6 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:35.077609 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06095b-d8db-4bdf-95df-4fc79f70a70e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:35.078241 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06095b-d8db-4bdf-95df-4fc79f70a70e service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:35.078573 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06095b-d8db-4bdf-95df-4fc79f70a70e service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:35.078886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06095b-d8db-4bdf-95df-4fc79f70a70e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:35.088945 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06095b-d8db-4bdf-95df-4fc79f70a70e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:35.090404 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06095b-d8db-4bdf-95df-4fc79f70a70e service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:35.100119 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 521/1066] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:11:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:37.626108 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75959820-18c9-4b5f-8199-b049eda9ce2b None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:37.626711 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75959820-18c9-4b5f-8199-b049eda9ce2b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:37.626711 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75959820-18c9-4b5f-8199-b049eda9ce2b None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:37.628542 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 546/1067] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:37.634382 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70cc2d-397e-4adc-bada-958eb882e922 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:37.634826 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70cc2d-397e-4adc-bada-958eb882e922 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:37.634938 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70cc2d-397e-4adc-bada-958eb882e922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:37.654664 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-4e70cc2d-397e-4adc-bada-958eb882e922 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:37.655865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-4e70cc2d-397e-4adc-bada-958eb882e922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:37.664457 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 522/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:11:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:11:38.007138 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75959820-18c9-4b5f-8199-b049eda9ce2b None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:38.019777 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75959820-18c9-4b5f-8199-b049eda9ce2b None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:38.023487 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce947502-2286-464d-9d16-24bc6e04c67c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:38.024071 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce947502-2286-464d-9d16-24bc6e04c67c service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:38.024344 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce947502-2286-464d-9d16-24bc6e04c67c service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:38.024613 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce947502-2286-464d-9d16-24bc6e04c67c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:38.033339 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce947502-2286-464d-9d16-24bc6e04c67c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:38.034837 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce947502-2286-464d-9d16-24bc6e04c67c service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:38.043925 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 547/1069] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:11:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:40.466230 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4330736-6349-4167-8b72-117663ad4835 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:40.467135 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4330736-6349-4167-8b72-117663ad4835 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:40.467135 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4330736-6349-4167-8b72-117663ad4835 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:40.469259 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 523/1070] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:11:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:40.478565 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a27e81-ed3b-4e26-b265-9c7a2ceaa6b4 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:40.479030 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a27e81-ed3b-4e26-b265-9c7a2ceaa6b4 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:40.479137 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a27e81-ed3b-4e26-b265-9c7a2ceaa6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:40.490140 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=61 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:40.503194 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-38a27e81-ed3b-4e26-b265-9c7a2ceaa6b4 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:40.504395 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-38a27e81-ed3b-4e26-b265-9c7a2ceaa6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:40.512803 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 548/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:11:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:11:40.849722 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4330736-6349-4167-8b72-117663ad4835 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:40.863178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4330736-6349-4167-8b72-117663ad4835 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:40.868366 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bd520-2757-4924-89d5-6c19371e51f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:40.868970 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bd520-2757-4924-89d5-6c19371e51f5 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:40.869247 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bd520-2757-4924-89d5-6c19371e51f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:40.869548 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bd520-2757-4924-89d5-6c19371e51f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:40.880397 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bd520-2757-4924-89d5-6c19371e51f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:40.881876 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bd520-2757-4924-89d5-6c19371e51f5 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:40.891388 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 524/1072] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:11:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:11:43.412121 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714f45e-f90c-47be-ae2b-8fc9ad1be695 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:43.412685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714f45e-f90c-47be-ae2b-8fc9ad1be695 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:43.412685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714f45e-f90c-47be-ae2b-8fc9ad1be695 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:43.414045 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 549/1073] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:43.420161 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27452a2c-1df9-49c5-96ab-78b7914b3bd0 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:43.420596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27452a2c-1df9-49c5-96ab-78b7914b3bd0 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:43.420764 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27452a2c-1df9-49c5-96ab-78b7914b3bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:43.442074 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-27452a2c-1df9-49c5-96ab-78b7914b3bd0 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:43.443299 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-27452a2c-1df9-49c5-96ab-78b7914b3bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:43.451585 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 525/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:11:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:11:43.797093 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714f45e-f90c-47be-ae2b-8fc9ad1be695 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:43.816223 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714f45e-f90c-47be-ae2b-8fc9ad1be695 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:43.820621 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5926e-dfa5-418a-9b01-a079692de913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:43.821209 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5926e-dfa5-418a-9b01-a079692de913 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:43.821478 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5926e-dfa5-418a-9b01-a079692de913 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:43.821751 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5926e-dfa5-418a-9b01-a079692de913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:43.831510 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5926e-dfa5-418a-9b01-a079692de913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:43.832940 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5926e-dfa5-418a-9b01-a079692de913 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:43.842341 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 550/1075] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:11:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:46.264878 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c2ecd-99c6-48a4-b69f-7acf02cf9689 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:46.265770 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c2ecd-99c6-48a4-b69f-7acf02cf9689 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:46.265770 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c2ecd-99c6-48a4-b69f-7acf02cf9689 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:46.267838 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 526/1076] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:11:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:46.273969 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd66d0d-7dc4-4374-87df-425a3cdb7220 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:46.274440 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd66d0d-7dc4-4374-87df-425a3cdb7220 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:46.274561 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd66d0d-7dc4-4374-87df-425a3cdb7220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:46.294425 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-cbd66d0d-7dc4-4374-87df-425a3cdb7220 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:46.295615 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-cbd66d0d-7dc4-4374-87df-425a3cdb7220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:46.304395 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 551/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:11:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:11:46.649200 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c2ecd-99c6-48a4-b69f-7acf02cf9689 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:46.665711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c2ecd-99c6-48a4-b69f-7acf02cf9689 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:46.670761 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c965995-6d9a-4508-b288-3ee91c24d881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:46.671365 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c965995-6d9a-4508-b288-3ee91c24d881 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:46.671640 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c965995-6d9a-4508-b288-3ee91c24d881 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:46.671910 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c965995-6d9a-4508-b288-3ee91c24d881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:46.682507 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c965995-6d9a-4508-b288-3ee91c24d881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:46.683984 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c965995-6d9a-4508-b288-3ee91c24d881 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:46.695076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 527/1078] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:11:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:49.154358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e3b7a-960d-4613-831c-ef94a00ece3b None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:49.155247 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e3b7a-960d-4613-831c-ef94a00ece3b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:49.155247 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e3b7a-960d-4613-831c-ef94a00ece3b None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:49.157453 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 552/1079] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:11:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:49.163945 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f67c1-55d0-441b-af0a-b0403cb7c9ab None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:49.164369 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f67c1-55d0-441b-af0a-b0403cb7c9ab None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:49.164481 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f67c1-55d0-441b-af0a-b0403cb7c9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:49.186518 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-9e8f67c1-55d0-441b-af0a-b0403cb7c9ab None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:49.187714 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-9e8f67c1-55d0-441b-af0a-b0403cb7c9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:49.197194 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 528/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:11:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:11:49.534874 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e3b7a-960d-4613-831c-ef94a00ece3b None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:49.547450 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e3b7a-960d-4613-831c-ef94a00ece3b None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:49.551656 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d02526-70e7-48c2-ad74-04cc705b5c87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:49.552247 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d02526-70e7-48c2-ad74-04cc705b5c87 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:49.552519 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d02526-70e7-48c2-ad74-04cc705b5c87 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:49.552784 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d02526-70e7-48c2-ad74-04cc705b5c87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:49.561671 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d02526-70e7-48c2-ad74-04cc705b5c87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:49.563141 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d02526-70e7-48c2-ad74-04cc705b5c87 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:49.572482 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 553/1081] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:11:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:51.964955 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080e9d5-f9ea-48ef-88ff-1b49f88aa36d None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:51.965619 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080e9d5-f9ea-48ef-88ff-1b49f88aa36d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:51.965619 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080e9d5-f9ea-48ef-88ff-1b49f88aa36d None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:51.966872 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 529/1082] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:51.972512 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261b11d-4a62-4b7b-8b3a-4131b611d925 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:51.972967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261b11d-4a62-4b7b-8b3a-4131b611d925 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:51.973068 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261b11d-4a62-4b7b-8b3a-4131b611d925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:51.992909 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-0261b11d-4a62-4b7b-8b3a-4131b611d925 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:51.994044 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-0261b11d-4a62-4b7b-8b3a-4131b611d925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:52.002507 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 554/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:11:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:11:52.333609 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080e9d5-f9ea-48ef-88ff-1b49f88aa36d None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:52.339831 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=46 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:52.346785 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080e9d5-f9ea-48ef-88ff-1b49f88aa36d None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:52.351132 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f06f3e-f2b8-4309-befe-758e7e21b173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:52.352048 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f06f3e-f2b8-4309-befe-758e7e21b173 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:52.352317 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f06f3e-f2b8-4309-befe-758e7e21b173 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:52.352591 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f06f3e-f2b8-4309-befe-758e7e21b173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:52.362636 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f06f3e-f2b8-4309-befe-758e7e21b173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:52.364473 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f06f3e-f2b8-4309-befe-758e7e21b173 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:52.376812 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 530/1084] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:11:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:54.781798 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86042d-70bd-44f8-9f41-48fdd7f05007 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:54.782685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86042d-70bd-44f8-9f41-48fdd7f05007 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:54.782685 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86042d-70bd-44f8-9f41-48fdd7f05007 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:54.784838 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 555/1085] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:11:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:54.793598 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43feeaba-9eb6-4840-9b10-45442facbd11 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:54.794064 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43feeaba-9eb6-4840-9b10-45442facbd11 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:54.794213 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43feeaba-9eb6-4840-9b10-45442facbd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:54.817191 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-43feeaba-9eb6-4840-9b10-45442facbd11 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:54.818412 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-43feeaba-9eb6-4840-9b10-45442facbd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:54.827463 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 531/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:11:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:11:55.157273 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86042d-70bd-44f8-9f41-48fdd7f05007 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:55.175552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86042d-70bd-44f8-9f41-48fdd7f05007 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:55.181998 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16713e7-d61a-4ee6-ae12-5517036fc040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:55.182892 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16713e7-d61a-4ee6-ae12-5517036fc040 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:55.183317 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16713e7-d61a-4ee6-ae12-5517036fc040 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:55.183602 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16713e7-d61a-4ee6-ae12-5517036fc040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:55.195037 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16713e7-d61a-4ee6-ae12-5517036fc040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:55.196475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16713e7-d61a-4ee6-ae12-5517036fc040 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:55.206518 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 556/1087] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:11:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:12:04.811421 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=8 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:05.202061 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=26 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:19.415543 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6fdef-1aae-4776-a44e-39ec536fb06c None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:19.416132 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6fdef-1aae-4776-a44e-39ec536fb06c None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:19.416132 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6fdef-1aae-4776-a44e-39ec536fb06c None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:19.417422 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 532/1088] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:12:19.424847 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0942d-4f9f-4bef-bb2c-822a7c88d37d None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:19.425542 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0942d-4f9f-4bef-bb2c-822a7c88d37d None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:19.426054 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0942d-4f9f-4bef-bb2c-822a7c88d37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:19.454729 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-e8c0942d-4f9f-4bef-bb2c-822a7c88d37d None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:12:19.456069 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-e8c0942d-4f9f-4bef-bb2c-822a7c88d37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:12:19.465464 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 557/1089] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:12:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:12:19.823102 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736fda7-fbf4-4aa2-9593-26b6c130b806 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:19.823386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736fda7-fbf4-4aa2-9593-26b6c130b806 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:19.823652 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736fda7-fbf4-4aa2-9593-26b6c130b806 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:19.824991 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 533/1090] 10.222.0.48 () {54 vars in 962 bytes} [Fri Sep 23 15:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:12:19.830511 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96d418-96d1-4c93-9000-14910fbe3cb6 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:19.830779 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96d418-96d1-4c93-9000-14910fbe3cb6 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:19.831067 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96d418-96d1-4c93-9000-14910fbe3cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:19.851950 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-db96d418-96d1-4c93-9000-14910fbe3cb6 None None] MFA Rules not processed for user `2f4a48b97bf9405eb44f593c41fe1e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:12:19.853153 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-db96d418-96d1-4c93-9000-14910fbe3cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:12:19.860733 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 558/1091] 10.222.0.48 () {58 vars in 1059 bytes} [Fri Sep 23 15:12:19 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:12:19.868215 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736fda7-fbf4-4aa2-9593-26b6c130b806 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:12:19.880163 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736fda7-fbf4-4aa2-9593-26b6c130b806 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:12:19.884147 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508306d1-eec3-42b3-b2cc-9bb0e8f413b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f4a48b97bf9405eb44f593c41fe1e4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:12:19.884744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508306d1-eec3-42b3-b2cc-9bb0e8f413b6 service glance] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:19.885018 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508306d1-eec3-42b3-b2cc-9bb0e8f413b6 service glance] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:19.885287 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508306d1-eec3-42b3-b2cc-9bb0e8f413b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:19.894550 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508306d1-eec3-42b3-b2cc-9bb0e8f413b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:12:19.895958 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508306d1-eec3-42b3-b2cc-9bb0e8f413b6 service glance] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:12:19.905710 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 534/1092] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:12:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:12:22.349960 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1e316-57cd-4fe5-b080-1d3dbb20ddbb None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:22.350592 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1e316-57cd-4fe5-b080-1d3dbb20ddbb None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:22.350592 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1e316-57cd-4fe5-b080-1d3dbb20ddbb None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:22.352845 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 559/1093] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:12:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:12:22.361623 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b01975-a92d-4558-ab14-4eb75e6260af None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:22.362137 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b01975-a92d-4558-ab14-4eb75e6260af None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:22.362324 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b01975-a92d-4558-ab14-4eb75e6260af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:22.386062 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-12b01975-a92d-4558-ab14-4eb75e6260af None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:12:22.387824 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-12b01975-a92d-4558-ab14-4eb75e6260af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:12:22.397955 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 535/1094] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:12:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:12:22.730047 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1e316-57cd-4fe5-b080-1d3dbb20ddbb None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:12:22.743617 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1e316-57cd-4fe5-b080-1d3dbb20ddbb None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:12:22.748708 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330ed83-58f2-4e2f-bc29-b13b18d7afdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:12:22.749290 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330ed83-58f2-4e2f-bc29-b13b18d7afdf admin admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:22.749562 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330ed83-58f2-4e2f-bc29-b13b18d7afdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:22.749874 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330ed83-58f2-4e2f-bc29-b13b18d7afdf admin admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:22.750481 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330ed83-58f2-4e2f-bc29-b13b18d7afdf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:12:22.752218 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: WARNING py.warnings [None req-a330ed83-58f2-4e2f-bc29-b13b18d7afdf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:12:22.752218 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: warnings.warn(msg) Sep 23 15:12:22.752218 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: Sep 23 15:12:22.753460 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330ed83-58f2-4e2f-bc29-b13b18d7afdf admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:12:22.771088 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 560/1095] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 15:12:22 2022] GET /identity/v3/projects => generated 1606 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:12:25.183901 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bfb65-7096-46ae-806c-5db67d24ed77 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:25.184526 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bfb65-7096-46ae-806c-5db67d24ed77 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:25.184526 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bfb65-7096-46ae-806c-5db67d24ed77 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:25.185863 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 536/1096] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:12:25.191753 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f87c9-c538-40d9-bd0b-550dd542507a None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:25.192226 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f87c9-c538-40d9-bd0b-550dd542507a None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:25.192346 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f87c9-c538-40d9-bd0b-550dd542507a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:25.214466 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-494f87c9-c538-40d9-bd0b-550dd542507a None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:12:25.215669 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-494f87c9-c538-40d9-bd0b-550dd542507a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:12:25.224856 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 561/1097] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:12:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:12:25.573138 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bfb65-7096-46ae-806c-5db67d24ed77 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:12:25.591003 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bfb65-7096-46ae-806c-5db67d24ed77 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:12:25.596793 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1a9f3-3c34-4bc9-94d6-eac3febdb714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:12:25.597389 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1a9f3-3c34-4bc9-94d6-eac3febdb714 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:25.597668 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1a9f3-3c34-4bc9-94d6-eac3febdb714 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:25.597969 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1a9f3-3c34-4bc9-94d6-eac3febdb714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:25.606404 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1a9f3-3c34-4bc9-94d6-eac3febdb714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:12:25.607993 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1a9f3-3c34-4bc9-94d6-eac3febdb714 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:12:25.617319 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 537/1098] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:12:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:12:28.183845 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170568d3-ac2d-4960-80e5-d4ed3da04938 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:28.184447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170568d3-ac2d-4960-80e5-d4ed3da04938 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:28.184447 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170568d3-ac2d-4960-80e5-d4ed3da04938 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:28.185709 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 562/1099] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:12:28.191975 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5692a-84a0-4708-b381-2fe330a52e83 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:28.192746 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5692a-84a0-4708-b381-2fe330a52e83 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:28.192915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5692a-84a0-4708-b381-2fe330a52e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:28.226970 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-b3d5692a-84a0-4708-b381-2fe330a52e83 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:12:28.228703 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-b3d5692a-84a0-4708-b381-2fe330a52e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:12:28.238491 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 538/1100] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:12:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:12:28.575149 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170568d3-ac2d-4960-80e5-d4ed3da04938 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:12:28.590329 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170568d3-ac2d-4960-80e5-d4ed3da04938 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:12:28.595386 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83911b-348a-4852-91b0-58bb06543eaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:12:28.595983 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83911b-348a-4852-91b0-58bb06543eaf service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:28.596288 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83911b-348a-4852-91b0-58bb06543eaf service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:28.596550 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83911b-348a-4852-91b0-58bb06543eaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:28.606347 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83911b-348a-4852-91b0-58bb06543eaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:12:28.607772 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83911b-348a-4852-91b0-58bb06543eaf service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:12:28.617301 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 563/1101] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:12:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:12:31.023364 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce53dfa-8f4e-460e-b60f-d03b4dec8675 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:31.023927 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce53dfa-8f4e-460e-b60f-d03b4dec8675 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:31.023927 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce53dfa-8f4e-460e-b60f-d03b4dec8675 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:31.025163 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 539/1102] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:12:31.031443 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0702bbe-d2d2-4144-8c36-914cee129736 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:31.032240 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0702bbe-d2d2-4144-8c36-914cee129736 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:31.032419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0702bbe-d2d2-4144-8c36-914cee129736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:31.053622 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-e0702bbe-d2d2-4144-8c36-914cee129736 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:12:31.054852 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-e0702bbe-d2d2-4144-8c36-914cee129736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:12:31.063850 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 564/1103] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:12:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:12:31.400817 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce53dfa-8f4e-460e-b60f-d03b4dec8675 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:12:31.418849 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce53dfa-8f4e-460e-b60f-d03b4dec8675 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:12:31.423986 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69a645-bd7f-423f-8fc6-e14d586205ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:12:31.424639 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69a645-bd7f-423f-8fc6-e14d586205ff service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:31.424912 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69a645-bd7f-423f-8fc6-e14d586205ff service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:31.425179 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69a645-bd7f-423f-8fc6-e14d586205ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:31.434572 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69a645-bd7f-423f-8fc6-e14d586205ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:12:31.436020 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69a645-bd7f-423f-8fc6-e14d586205ff service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:12:31.445211 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 540/1104] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:12:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:12:33.976156 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d03d6-d9d4-4c6c-945e-5af48173477c None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:33.976693 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d03d6-d9d4-4c6c-945e-5af48173477c None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:33.976693 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d03d6-d9d4-4c6c-945e-5af48173477c None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:33.978687 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 565/1105] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:12:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:12:33.987412 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d7ac7-20e6-4737-bbc9-c82416b50486 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:33.987841 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d7ac7-20e6-4737-bbc9-c82416b50486 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:33.988027 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d7ac7-20e6-4737-bbc9-c82416b50486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:34.015593 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-498d7ac7-20e6-4737-bbc9-c82416b50486 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:12:34.016811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-498d7ac7-20e6-4737-bbc9-c82416b50486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:12:34.026593 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 541/1106] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:12:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:12:34.366644 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d03d6-d9d4-4c6c-945e-5af48173477c None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:12:34.384695 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d03d6-d9d4-4c6c-945e-5af48173477c None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:12:34.391217 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ae94b-ad7d-4d3d-8e9c-9d3b86c1d5cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:12:34.392068 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ae94b-ad7d-4d3d-8e9c-9d3b86c1d5cc service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:34.392415 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ae94b-ad7d-4d3d-8e9c-9d3b86c1d5cc service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:34.392888 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ae94b-ad7d-4d3d-8e9c-9d3b86c1d5cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:34.403028 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ae94b-ad7d-4d3d-8e9c-9d3b86c1d5cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:12:34.404508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ae94b-ad7d-4d3d-8e9c-9d3b86c1d5cc service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:12:34.414614 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 566/1107] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:12:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:12:36.984686 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2beb02-5094-494f-9257-ab97e8ad13fc None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:36.985523 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2beb02-5094-494f-9257-ab97e8ad13fc None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:36.985523 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2beb02-5094-494f-9257-ab97e8ad13fc None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:36.987625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 542/1108] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 15:12:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:12:36.996178 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6214b5-5837-4188-ac73-4f48a7a5f39a None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:36.996597 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6214b5-5837-4188-ac73-4f48a7a5f39a None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:36.996756 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6214b5-5837-4188-ac73-4f48a7a5f39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:37.019606 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-de6214b5-5837-4188-ac73-4f48a7a5f39a None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:12:37.020788 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-de6214b5-5837-4188-ac73-4f48a7a5f39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:12:37.029788 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 567/1109] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 15:12:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:12:37.364503 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2beb02-5094-494f-9257-ab97e8ad13fc None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:12:37.377529 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2beb02-5094-494f-9257-ab97e8ad13fc None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:12:37.382656 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9bffa-6448-4d35-a84d-67a2b52eaab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:12:37.383255 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9bffa-6448-4d35-a84d-67a2b52eaab7 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:37.383526 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9bffa-6448-4d35-a84d-67a2b52eaab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:37.383790 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9bffa-6448-4d35-a84d-67a2b52eaab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:37.394599 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9bffa-6448-4d35-a84d-67a2b52eaab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:12:37.396016 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9bffa-6448-4d35-a84d-67a2b52eaab7 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:12:37.405475 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 543/1110] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:12:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:12:47.014584 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=33 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:47.401182 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=33 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:52.493167 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d033fe7-2f5a-47ec-b65a-367cedd10b18 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:52.493883 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d033fe7-2f5a-47ec-b65a-367cedd10b18 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:52.493883 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d033fe7-2f5a-47ec-b65a-367cedd10b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:52.515293 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-0d033fe7-2f5a-47ec-b65a-367cedd10b18 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:13:52.516469 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-0d033fe7-2f5a-47ec-b65a-367cedd10b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:13:52.524772 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 568/1111] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:13:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:13:52.532747 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2555f-b5cd-495d-b62a-43ff66acc492 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:52.533385 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2555f-b5cd-495d-b62a-43ff66acc492 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:52.533385 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2555f-b5cd-495d-b62a-43ff66acc492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:52.554691 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-79f2555f-b5cd-495d-b62a-43ff66acc492 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:13:52.555899 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-79f2555f-b5cd-495d-b62a-43ff66acc492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:13:52.565385 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 544/1112] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:13:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:13:52.570355 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d033fe7-2f5a-47ec-b65a-367cedd10b18 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:52.580322 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d033fe7-2f5a-47ec-b65a-367cedd10b18 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:52.585239 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c698f4a-d030-4308-9490-5622d77514de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:52.585875 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c698f4a-d030-4308-9490-5622d77514de admin admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:52.586145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c698f4a-d030-4308-9490-5622d77514de admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:52.586412 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c698f4a-d030-4308-9490-5622d77514de admin admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:52.587081 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c698f4a-d030-4308-9490-5622d77514de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:52.587372 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c698f4a-d030-4308-9490-5622d77514de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:52.588509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: WARNING py.warnings [None req-7c698f4a-d030-4308-9490-5622d77514de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:13:52.588509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: warnings.warn(msg) Sep 23 15:13:52.588509 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: Sep 23 15:13:52.589399 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c698f4a-d030-4308-9490-5622d77514de admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:52.603082 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 569/1113] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 15:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:52.616582 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2555f-b5cd-495d-b62a-43ff66acc492 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:52.629720 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2555f-b5cd-495d-b62a-43ff66acc492 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:52.635592 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3201dee-4461-4b9f-a405-71537d986e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:52.636198 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3201dee-4461-4b9f-a405-71537d986e72 admin admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:52.636474 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3201dee-4461-4b9f-a405-71537d986e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:52.636723 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3201dee-4461-4b9f-a405-71537d986e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:52.637399 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3201dee-4461-4b9f-a405-71537d986e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:52.639212 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: WARNING py.warnings [None req-c3201dee-4461-4b9f-a405-71537d986e72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:13:52.639212 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: warnings.warn(msg) Sep 23 15:13:52.639212 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: Sep 23 15:13:52.640431 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3201dee-4461-4b9f-a405-71537d986e72 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:52.671354 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 545/1114] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 15:13:52 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:13:52.675586 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c698f4a-d030-4308-9490-5622d77514de admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:52.685573 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c698f4a-d030-4308-9490-5622d77514de admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:52.748041 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0e89b-9cff-46ef-ad4f-77ca237fee92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:52.748576 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0e89b-9cff-46ef-ad4f-77ca237fee92 admin admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:52.748848 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0e89b-9cff-46ef-ad4f-77ca237fee92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:52.749120 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0e89b-9cff-46ef-ad4f-77ca237fee92 admin admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:52.749765 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0e89b-9cff-46ef-ad4f-77ca237fee92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:52.750774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: WARNING py.warnings [None req-1ea0e89b-9cff-46ef-ad4f-77ca237fee92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:13:52.750774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: warnings.warn(msg) Sep 23 15:13:52.750774 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: Sep 23 15:13:52.752057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0e89b-9cff-46ef-ad4f-77ca237fee92 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:52.774989 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 570/1115] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 15:13:52 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:13:52.779266 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3201dee-4461-4b9f-a405-71537d986e72 admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:52.790091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3201dee-4461-4b9f-a405-71537d986e72 admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:52.795111 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6bb9c-50e8-48e9-870e-efd81a95b815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:52.795738 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6bb9c-50e8-48e9-870e-efd81a95b815 admin admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:52.795996 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6bb9c-50e8-48e9-870e-efd81a95b815 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:52.796268 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6bb9c-50e8-48e9-870e-efd81a95b815 admin admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:52.796912 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6bb9c-50e8-48e9-870e-efd81a95b815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:52.797986 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: WARNING py.warnings [None req-d4d6bb9c-50e8-48e9-870e-efd81a95b815 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:13:52.797986 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: warnings.warn(msg) Sep 23 15:13:52.797986 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: Sep 23 15:13:52.798875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6bb9c-50e8-48e9-870e-efd81a95b815 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:52.811579 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 546/1116] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 15:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:13:52.815666 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0e89b-9cff-46ef-ad4f-77ca237fee92 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:52.825957 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0e89b-9cff-46ef-ad4f-77ca237fee92 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:52.831929 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac028c-cb8d-4d41-b7ba-8cd817818146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:52.832525 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac028c-cb8d-4d41-b7ba-8cd817818146 admin admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:52.832799 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac028c-cb8d-4d41-b7ba-8cd817818146 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:52.833067 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac028c-cb8d-4d41-b7ba-8cd817818146 admin admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:52.833724 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac028c-cb8d-4d41-b7ba-8cd817818146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:52.834738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: WARNING py.warnings [None req-c7ac028c-cb8d-4d41-b7ba-8cd817818146 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:13:52.834738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: warnings.warn(msg) Sep 23 15:13:52.834738 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: Sep 23 15:13:52.835620 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac028c-cb8d-4d41-b7ba-8cd817818146 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:52.849286 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 571/1117] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 15:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:13:52.854651 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6bb9c-50e8-48e9-870e-efd81a95b815 admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:52.869399 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6bb9c-50e8-48e9-870e-efd81a95b815 admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:52.877470 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0202da-3a4d-4f54-877b-e93dc81e34cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:52.878145 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0202da-3a4d-4f54-877b-e93dc81e34cd admin admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:52.878420 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0202da-3a4d-4f54-877b-e93dc81e34cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:52.878685 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0202da-3a4d-4f54-877b-e93dc81e34cd admin admin] PATH_INFO: `/v3/projects/fe55303af6f4452dab6971a45fe11fb0/users/62b94b06f51144f39bbdb139566ad7cd/roles/dfd00108a3dd42f1a9dd0335f4b8f508` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:52.894799 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0202da-3a4d-4f54-877b-e93dc81e34cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe55303af6f4452dab6971a45fe11fb0, user_id=62b94b06f51144f39bbdb139566ad7cd, role_id=dfd00108a3dd42f1a9dd0335f4b8f508)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:52.895864 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: WARNING py.warnings [None req-0f0202da-3a4d-4f54-877b-e93dc81e34cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:13:52.895864 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: warnings.warn(msg) Sep 23 15:13:52.895864 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: Sep 23 15:13:52.897840 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0202da-3a4d-4f54-877b-e93dc81e34cd admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:52.914062 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 547/1118] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 15:13:52 2022] PUT /identity/v3/projects/fe55303af6f4452dab6971a45fe11fb0/users/62b94b06f51144f39bbdb139566ad7cd/roles/dfd00108a3dd42f1a9dd0335f4b8f508 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:13:52.926529 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4403cb-35bf-439b-afe3-6b761f3b72aa None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:52.926814 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4403cb-35bf-439b-afe3-6b761f3b72aa None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:52.927087 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4403cb-35bf-439b-afe3-6b761f3b72aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:52.957394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-dc4403cb-35bf-439b-afe3-6b761f3b72aa None None] MFA Rules not processed for user `62b94b06f51144f39bbdb139566ad7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:13:52.958647 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-dc4403cb-35bf-439b-afe3-6b761f3b72aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:13:53.023672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 572/1119] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:13:52 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:13:53.042699 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354e065-bb26-441c-9d8a-73e1dc492246 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:53.043021 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354e065-bb26-441c-9d8a-73e1dc492246 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:53.043315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354e065-bb26-441c-9d8a-73e1dc492246 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:53.044674 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 548/1120] 10.222.0.48 () {54 vars in 963 bytes} [Fri Sep 23 15:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:13:53.051663 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cae5fc-8f7f-4daa-8212-1cf80fccc571 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:53.051947 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cae5fc-8f7f-4daa-8212-1cf80fccc571 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:53.052232 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cae5fc-8f7f-4daa-8212-1cf80fccc571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:53.075344 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-a2cae5fc-8f7f-4daa-8212-1cf80fccc571 None None] MFA Rules not processed for user `0274d60e5bf14a4a9d3477e0efe31988`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:13:53.076558 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-a2cae5fc-8f7f-4daa-8212-1cf80fccc571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:13:53.124134 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:53.133358 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 573/1121] 10.222.0.48 () {58 vars in 1060 bytes} [Fri Sep 23 15:13:53 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:13:53.141204 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354e065-bb26-441c-9d8a-73e1dc492246 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:53.152607 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354e065-bb26-441c-9d8a-73e1dc492246 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:53.156316 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af701a1-b9fb-4456-ba2d-c3717bc8bcac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0274d60e5bf14a4a9d3477e0efe31988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:53.156906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af701a1-b9fb-4456-ba2d-c3717bc8bcac service cinder] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:53.157181 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af701a1-b9fb-4456-ba2d-c3717bc8bcac service cinder] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:53.157446 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af701a1-b9fb-4456-ba2d-c3717bc8bcac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:53.166180 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af701a1-b9fb-4456-ba2d-c3717bc8bcac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:53.167645 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af701a1-b9fb-4456-ba2d-c3717bc8bcac service cinder] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:53.177004 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 549/1122] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:13:53 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:13:53.219635 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0382d01-436e-49e5-a910-1c1401fa10d2 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:53.219920 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0382d01-436e-49e5-a910-1c1401fa10d2 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:53.220194 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0382d01-436e-49e5-a910-1c1401fa10d2 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:53.221439 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 574/1123] 10.222.0.48 () {52 vars in 830 bytes} [Fri Sep 23 15:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:13:53.225675 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af701a1-b9fb-4456-ba2d-c3717bc8bcac service cinder] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:53.298505 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af701a1-b9fb-4456-ba2d-c3717bc8bcac service cinder] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:53.304305 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9a468-c66d-4030-be30-e52c19921ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:53.304944 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9a468-c66d-4030-be30-e52c19921ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:53.305221 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9a468-c66d-4030-be30-e52c19921ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:53.305497 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9a468-c66d-4030-be30-e52c19921ff5 admin admin] PATH_INFO: `/v3/users/62b94b06f51144f39bbdb139566ad7cd` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:53.306731 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9a468-c66d-4030-be30-e52c19921ff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62b94b06f51144f39bbdb139566ad7cd)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:53.307759 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: WARNING py.warnings [None req-ceb9a468-c66d-4030-be30-e52c19921ff5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:13:53.307759 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: warnings.warn(msg) Sep 23 15:13:53.307759 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: Sep 23 15:13:53.308987 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9a468-c66d-4030-be30-e52c19921ff5 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:53.381372 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-ceb9a468-c66d-4030-be30-e52c19921ff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62b94b06f51144f39bbdb139566ad7cd'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:13:53.382042 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-ceb9a468-c66d-4030-be30-e52c19921ff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62b94b06f51144f39bbdb139566ad7cd'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:13:53.393383 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-ceb9a468-c66d-4030-be30-e52c19921ff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62b94b06f51144f39bbdb139566ad7cd'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:13:53.417063 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-ceb9a468-c66d-4030-be30-e52c19921ff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62b94b06f51144f39bbdb139566ad7cd'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:13:53.433886 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-ceb9a468-c66d-4030-be30-e52c19921ff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62b94b06f51144f39bbdb139566ad7cd'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:13:53.439973 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 550/1124] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 15:13:53 2022] DELETE /identity/v3/users/62b94b06f51144f39bbdb139566ad7cd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:13:53.444502 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06019a5-d44b-46ee-ad58-bf933093ef65 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:53.444783 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06019a5-d44b-46ee-ad58-bf933093ef65 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:53.445051 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06019a5-d44b-46ee-ad58-bf933093ef65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:53.463962 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-d06019a5-d44b-46ee-ad58-bf933093ef65 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:13:53.465145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-d06019a5-d44b-46ee-ad58-bf933093ef65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:13:53.525546 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 575/1125] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:13:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:13:53.536150 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9a468-c66d-4030-be30-e52c19921ff5 admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:53.537779 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-ceb9a468-c66d-4030-be30-e52c19921ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:13:53.543487 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:53.598112 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9a468-c66d-4030-be30-e52c19921ff5 admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:53.602574 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d67c08-2a9f-4cae-aba4-dbac0ceaee69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:53.603181 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d67c08-2a9f-4cae-aba4-dbac0ceaee69 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:53.603454 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d67c08-2a9f-4cae-aba4-dbac0ceaee69 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:53.603724 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d67c08-2a9f-4cae-aba4-dbac0ceaee69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:53.613209 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d67c08-2a9f-4cae-aba4-dbac0ceaee69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:53.614685 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d67c08-2a9f-4cae-aba4-dbac0ceaee69 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:53.624117 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 551/1126] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:13:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:13:54.008688 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06019a5-d44b-46ee-ad58-bf933093ef65 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:54.010253 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-d06019a5-d44b-46ee-ad58-bf933093ef65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:13:54.023472 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06019a5-d44b-46ee-ad58-bf933093ef65 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:54.028830 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7299b98-b5f4-48cb-b600-bd2b2f8af84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:54.029510 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7299b98-b5f4-48cb-b600-bd2b2f8af84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:54.029779 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7299b98-b5f4-48cb-b600-bd2b2f8af84a admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:54.030043 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7299b98-b5f4-48cb-b600-bd2b2f8af84a admin admin] PATH_INFO: `/v3/projects/fe55303af6f4452dab6971a45fe11fb0` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:54.031201 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7299b98-b5f4-48cb-b600-bd2b2f8af84a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe55303af6f4452dab6971a45fe11fb0)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:54.032834 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: WARNING py.warnings [None req-a7299b98-b5f4-48cb-b600-bd2b2f8af84a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:13:54.032834 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: warnings.warn(msg) Sep 23 15:13:54.032834 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: Sep 23 15:13:54.034231 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7299b98-b5f4-48cb-b600-bd2b2f8af84a admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:54.097619 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-a7299b98-b5f4-48cb-b600-bd2b2f8af84a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe55303af6f4452dab6971a45fe11fb0', 'request_id': 'req-a7299b98-b5f4-48cb-b600-bd2b2f8af84a'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:13:54.109930 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-a7299b98-b5f4-48cb-b600-bd2b2f8af84a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe55303af6f4452dab6971a45fe11fb0', 'request_id': 'req-a7299b98-b5f4-48cb-b600-bd2b2f8af84a'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:13:54.116546 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-a7299b98-b5f4-48cb-b600-bd2b2f8af84a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe55303af6f4452dab6971a45fe11fb0', 'request_id': 'req-a7299b98-b5f4-48cb-b600-bd2b2f8af84a'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:13:54.134592 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-a7299b98-b5f4-48cb-b600-bd2b2f8af84a admin admin] The token cache is being invalidate because project fe55303af6f4452dab6971a45fe11fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:13:54.134753 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-a7299b98-b5f4-48cb-b600-bd2b2f8af84a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:13:54.135403 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-a7299b98-b5f4-48cb-b600-bd2b2f8af84a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:13:54.136964 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 576/1127] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 15:13:54 2022] DELETE /identity/v3/projects/fe55303af6f4452dab6971a45fe11fb0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:14:03.620180 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=25 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:14:04.131831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:15:20.921223 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfb523-a046-4b4a-98d5-6130aa2820c3 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:20.921852 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfb523-a046-4b4a-98d5-6130aa2820c3 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:20.921852 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfb523-a046-4b4a-98d5-6130aa2820c3 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:20.923141 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 552/1128] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:15:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:15:20.928365 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24132d0d-3950-4ea0-9ae3-a30c6b3df33b None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:20.928823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24132d0d-3950-4ea0-9ae3-a30c6b3df33b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:20.928934 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24132d0d-3950-4ea0-9ae3-a30c6b3df33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:21.000912 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-24132d0d-3950-4ea0-9ae3-a30c6b3df33b None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:15:21.002080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-24132d0d-3950-4ea0-9ae3-a30c6b3df33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:15:21.096194 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 577/1129] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:15:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:15:21.253285 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfb523-a046-4b4a-98d5-6130aa2820c3 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:15:21.256219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-b2dfb523-a046-4b4a-98d5-6130aa2820c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:15:21.355705 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfb523-a046-4b4a-98d5-6130aa2820c3 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:15:21.361155 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254fa89-c373-4b3e-888d-2d3aa0d4eb8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:15:21.361794 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254fa89-c373-4b3e-888d-2d3aa0d4eb8a service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:21.362075 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254fa89-c373-4b3e-888d-2d3aa0d4eb8a service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:21.362349 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254fa89-c373-4b3e-888d-2d3aa0d4eb8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:21.371007 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254fa89-c373-4b3e-888d-2d3aa0d4eb8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:15:21.372598 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254fa89-c373-4b3e-888d-2d3aa0d4eb8a service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:15:21.382366 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 553/1130] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:15:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:15:23.010584 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d0668-d1a6-49a9-a5f9-634d6ee0037e None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:23.011435 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d0668-d1a6-49a9-a5f9-634d6ee0037e None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:23.011435 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d0668-d1a6-49a9-a5f9-634d6ee0037e None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:23.013579 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 578/1131] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:15:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:15:23.019404 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfffc5d-0cfb-4ad5-8a70-4928d8be9b41 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:23.019861 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfffc5d-0cfb-4ad5-8a70-4928d8be9b41 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:23.019998 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfffc5d-0cfb-4ad5-8a70-4928d8be9b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:23.044784 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-8cfffc5d-0cfb-4ad5-8a70-4928d8be9b41 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:15:23.046038 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-8cfffc5d-0cfb-4ad5-8a70-4928d8be9b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:15:23.054354 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 554/1132] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:15:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:15:23.213911 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d0668-d1a6-49a9-a5f9-634d6ee0037e None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:15:23.230552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d0668-d1a6-49a9-a5f9-634d6ee0037e None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:15:23.236122 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa21376-6d37-461a-a59f-72876ce38905 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:15:23.236714 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa21376-6d37-461a-a59f-72876ce38905 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:23.236988 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa21376-6d37-461a-a59f-72876ce38905 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:23.237260 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa21376-6d37-461a-a59f-72876ce38905 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:23.245595 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa21376-6d37-461a-a59f-72876ce38905 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:15:23.247225 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa21376-6d37-461a-a59f-72876ce38905 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:15:23.256641 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 579/1133] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:15:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:15:26.812386 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276c339-61ee-4c9f-ad2c-7f89a297cba2 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:26.812950 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276c339-61ee-4c9f-ad2c-7f89a297cba2 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:26.812950 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276c339-61ee-4c9f-ad2c-7f89a297cba2 None None] PATH_INFO: `/v3` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:26.814299 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 555/1134] 10.222.0.89 () {54 vars in 925 bytes} [Fri Sep 23 15:15:26 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:15:26.820743 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b2015-4c5b-4331-bd8c-0a5262265a7a None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:26.821201 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b2015-4c5b-4331-bd8c-0a5262265a7a None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:26.821319 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b2015-4c5b-4331-bd8c-0a5262265a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:26.853513 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-c56b2015-4c5b-4331-bd8c-0a5262265a7a None None] MFA Rules not processed for user `1d4347073208466b885d960d92bdbc77`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:15:26.854755 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-c56b2015-4c5b-4331-bd8c-0a5262265a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:15:26.913862 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:15:26.924368 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 580/1135] 10.222.0.89 () {58 vars in 1015 bytes} [Fri Sep 23 15:15:26 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:15:33.039819 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=42 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:15:35.281368 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b4295-eab2-40a9-84bc-6db2c0fc048b None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:35.282098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b4295-eab2-40a9-84bc-6db2c0fc048b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:35.282098 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b4295-eab2-40a9-84bc-6db2c0fc048b None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:35.283311 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 556/1136] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:15:35.288394 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5e8dd-3192-46ef-9c0a-e25310c7a43b None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:35.288866 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5e8dd-3192-46ef-9c0a-e25310c7a43b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:35.288972 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5e8dd-3192-46ef-9c0a-e25310c7a43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:35.312548 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-e5d5e8dd-3192-46ef-9c0a-e25310c7a43b None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:15:35.313806 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-e5d5e8dd-3192-46ef-9c0a-e25310c7a43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:15:35.323126 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 581/1137] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:15:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:15:35.484889 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b4295-eab2-40a9-84bc-6db2c0fc048b None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:15:35.503944 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b4295-eab2-40a9-84bc-6db2c0fc048b None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:15:35.509275 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7464b55-e5db-425d-bcef-293fe8eb32b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:15:35.509921 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7464b55-e5db-425d-bcef-293fe8eb32b8 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:35.510195 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7464b55-e5db-425d-bcef-293fe8eb32b8 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:35.510466 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7464b55-e5db-425d-bcef-293fe8eb32b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:35.518840 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7464b55-e5db-425d-bcef-293fe8eb32b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:15:35.520444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7464b55-e5db-425d-bcef-293fe8eb32b8 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:15:35.530218 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 557/1138] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:15:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:15:35.828985 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf98697-88fd-46ce-b1ff-1318e672c4a0 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:35.829378 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf98697-88fd-46ce-b1ff-1318e672c4a0 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:35.829745 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf98697-88fd-46ce-b1ff-1318e672c4a0 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:35.831203 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 582/1139] 10.222.0.48 () {54 vars in 961 bytes} [Fri Sep 23 15:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:15:35.836479 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b0fe2-ff72-4a6c-bf82-c0964fcf1e43 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:35.836751 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b0fe2-ff72-4a6c-bf82-c0964fcf1e43 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:35.837051 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b0fe2-ff72-4a6c-bf82-c0964fcf1e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:35.857981 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-af2b0fe2-ff72-4a6c-bf82-c0964fcf1e43 None None] MFA Rules not processed for user `1d4347073208466b885d960d92bdbc77`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:15:35.859366 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-af2b0fe2-ff72-4a6c-bf82-c0964fcf1e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:15:35.869078 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 558/1140] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Sep 23 15:15:35 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:15:35.876443 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf98697-88fd-46ce-b1ff-1318e672c4a0 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:15:35.890498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf98697-88fd-46ce-b1ff-1318e672c4a0 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:15:35.895697 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74211c5-69d0-4fda-b073-1f89163e94ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4347073208466b885d960d92bdbc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:15:35.896303 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74211c5-69d0-4fda-b073-1f89163e94ad service placement] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:35.896578 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74211c5-69d0-4fda-b073-1f89163e94ad service placement] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:35.896847 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74211c5-69d0-4fda-b073-1f89163e94ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:35.905133 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74211c5-69d0-4fda-b073-1f89163e94ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:15:35.906819 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74211c5-69d0-4fda-b073-1f89163e94ad service placement] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:15:35.916445 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 583/1141] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:15:35 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:15:37.144250 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dc831-27ca-4ad7-b7f5-d62bcb7e43c8 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:37.144880 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dc831-27ca-4ad7-b7f5-d62bcb7e43c8 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:37.144880 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dc831-27ca-4ad7-b7f5-d62bcb7e43c8 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:37.146936 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 559/1142] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:15:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:15:37.155706 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ee062-d101-423a-815e-bbc55baeeee8 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:37.156175 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ee062-d101-423a-815e-bbc55baeeee8 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:37.156269 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ee062-d101-423a-815e-bbc55baeeee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:37.175786 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-823ee062-d101-423a-815e-bbc55baeeee8 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:15:37.176984 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-823ee062-d101-423a-815e-bbc55baeeee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:15:37.186484 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 584/1143] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:15:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:15:37.345065 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dc831-27ca-4ad7-b7f5-d62bcb7e43c8 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:15:37.360903 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dc831-27ca-4ad7-b7f5-d62bcb7e43c8 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:15:37.366740 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8cf2f-ecc0-4bbe-8612-1cede1dbfb2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:15:37.367375 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8cf2f-ecc0-4bbe-8612-1cede1dbfb2e service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:37.367651 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8cf2f-ecc0-4bbe-8612-1cede1dbfb2e service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:37.367925 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8cf2f-ecc0-4bbe-8612-1cede1dbfb2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:37.376308 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8cf2f-ecc0-4bbe-8612-1cede1dbfb2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:15:37.377995 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8cf2f-ecc0-4bbe-8612-1cede1dbfb2e service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:15:37.387202 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 560/1144] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:15:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:15:42.001031 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73666a91-93f5-490f-bda1-5564ba375187 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:42.001977 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73666a91-93f5-490f-bda1-5564ba375187 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:42.001977 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73666a91-93f5-490f-bda1-5564ba375187 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:42.004143 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 585/1145] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:15:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:15:42.010022 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084da32e-002c-4436-86f7-be4c7d790416 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:42.010482 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084da32e-002c-4436-86f7-be4c7d790416 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:42.010576 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084da32e-002c-4436-86f7-be4c7d790416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:42.031349 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-084da32e-002c-4436-86f7-be4c7d790416 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:15:42.032570 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-084da32e-002c-4436-86f7-be4c7d790416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:15:42.041007 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 561/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:15:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:15:42.388535 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73666a91-93f5-490f-bda1-5564ba375187 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:15:42.391566 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-73666a91-93f5-490f-bda1-5564ba375187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:15:42.456848 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73666a91-93f5-490f-bda1-5564ba375187 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:15:42.460815 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11c551-ea2d-4342-bee0-dfb7dd183f88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:15:42.461443 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11c551-ea2d-4342-bee0-dfb7dd183f88 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:42.461719 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11c551-ea2d-4342-bee0-dfb7dd183f88 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:42.462004 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11c551-ea2d-4342-bee0-dfb7dd183f88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:42.471416 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11c551-ea2d-4342-bee0-dfb7dd183f88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:15:42.473199 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11c551-ea2d-4342-bee0-dfb7dd183f88 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:15:42.482672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 586/1147] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:15:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:15:44.847279 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66e2d8-310f-42bf-afcd-6bee041d3c76 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:44.848585 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66e2d8-310f-42bf-afcd-6bee041d3c76 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:44.848585 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66e2d8-310f-42bf-afcd-6bee041d3c76 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:44.850676 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 562/1148] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:15:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:15:44.859259 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19399b9-ef11-428e-96f9-0cd429c9bfdf None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:44.859981 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19399b9-ef11-428e-96f9-0cd429c9bfdf None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:44.860178 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19399b9-ef11-428e-96f9-0cd429c9bfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:44.880475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-d19399b9-ef11-428e-96f9-0cd429c9bfdf None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:15:44.881677 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-d19399b9-ef11-428e-96f9-0cd429c9bfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:15:44.890539 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 587/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:15:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:15:45.244234 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66e2d8-310f-42bf-afcd-6bee041d3c76 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:15:45.259497 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66e2d8-310f-42bf-afcd-6bee041d3c76 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:15:45.263556 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e04bfc-a316-45fa-91eb-5340372fe9a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:15:45.264165 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e04bfc-a316-45fa-91eb-5340372fe9a0 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:45.264439 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e04bfc-a316-45fa-91eb-5340372fe9a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:45.264711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e04bfc-a316-45fa-91eb-5340372fe9a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:45.274131 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e04bfc-a316-45fa-91eb-5340372fe9a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:15:45.275617 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e04bfc-a316-45fa-91eb-5340372fe9a0 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:15:45.285096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 563/1150] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:15:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:15:49.568599 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764bac6-7042-4209-b72e-8f17c304223b None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:49.569231 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764bac6-7042-4209-b72e-8f17c304223b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:49.569231 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764bac6-7042-4209-b72e-8f17c304223b None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:49.571295 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 588/1151] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:15:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:15:49.579611 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc736ac6-ef07-4a01-a155-447a7a674132 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:49.580090 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc736ac6-ef07-4a01-a155-447a7a674132 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:49.580192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc736ac6-ef07-4a01-a155-447a7a674132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:49.600780 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-fc736ac6-ef07-4a01-a155-447a7a674132 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:15:49.602010 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-fc736ac6-ef07-4a01-a155-447a7a674132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:15:49.611865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 564/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:15:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:15:49.965555 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764bac6-7042-4209-b72e-8f17c304223b None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:15:49.967714 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-4764bac6-7042-4209-b72e-8f17c304223b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:15:50.027036 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764bac6-7042-4209-b72e-8f17c304223b None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:15:50.031325 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3104d4-81ff-4263-91dc-8f04308c3071 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0274d60e5bf14a4a9d3477e0efe31988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:15:50.031909 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3104d4-81ff-4263-91dc-8f04308c3071 service cinder] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:50.032181 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3104d4-81ff-4263-91dc-8f04308c3071 service cinder] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:50.032461 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3104d4-81ff-4263-91dc-8f04308c3071 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:50.044221 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3104d4-81ff-4263-91dc-8f04308c3071 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:15:50.046632 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3104d4-81ff-4263-91dc-8f04308c3071 service cinder] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:15:50.057458 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 589/1153] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:15:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:15:52.419747 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da65a1a-73e3-46b0-b7ab-b18006e6674a None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:52.420374 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da65a1a-73e3-46b0-b7ab-b18006e6674a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:52.420374 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da65a1a-73e3-46b0-b7ab-b18006e6674a None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:52.421655 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 565/1154] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:15:52.428219 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f134e3-8577-4cca-8474-16609f320a76 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:52.428945 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f134e3-8577-4cca-8474-16609f320a76 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:52.429059 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f134e3-8577-4cca-8474-16609f320a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:52.458967 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-46f134e3-8577-4cca-8474-16609f320a76 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:15:52.460166 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-46f134e3-8577-4cca-8474-16609f320a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:15:52.469373 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 590/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:15:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:15:52.835160 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da65a1a-73e3-46b0-b7ab-b18006e6674a None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:15:52.838413 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-4da65a1a-73e3-46b0-b7ab-b18006e6674a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:15:52.872009 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da65a1a-73e3-46b0-b7ab-b18006e6674a None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:15:52.878094 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17835c5f-78e7-458b-91fe-1e8545858054 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0274d60e5bf14a4a9d3477e0efe31988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:15:52.878701 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17835c5f-78e7-458b-91fe-1e8545858054 service cinder] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:15:52.878977 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17835c5f-78e7-458b-91fe-1e8545858054 service cinder] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:15:52.879246 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17835c5f-78e7-458b-91fe-1e8545858054 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:15:52.889889 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17835c5f-78e7-458b-91fe-1e8545858054 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:15:52.891346 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17835c5f-78e7-458b-91fe-1e8545858054 service cinder] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:15:52.901114 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 566/1156] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:15:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:16:02.451949 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=70 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:16:02.896687 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=38 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:17:09.424210 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fabb2-1432-4897-95da-df8427a7d6e2 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:09.424868 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fabb2-1432-4897-95da-df8427a7d6e2 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:09.424868 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fabb2-1432-4897-95da-df8427a7d6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:09.429241 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59afec-57f2-46e1-a46e-3976b38051d4 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:09.429674 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59afec-57f2-46e1-a46e-3976b38051d4 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:09.429834 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59afec-57f2-46e1-a46e-3976b38051d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:09.445398 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-2f5fabb2-1432-4897-95da-df8427a7d6e2 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:17:09.446616 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-2f5fabb2-1432-4897-95da-df8427a7d6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:09.451086 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-0d59afec-57f2-46e1-a46e-3976b38051d4 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:17:09.452268 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-0d59afec-57f2-46e1-a46e-3976b38051d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:09.454373 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 591/1157] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:17:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:17:09.460631 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 567/1158] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:17:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:17:09.462743 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9f0b7-a820-4637-8d21-89db224f6fb4 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:09.463095 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9f0b7-a820-4637-8d21-89db224f6fb4 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:09.463372 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9f0b7-a820-4637-8d21-89db224f6fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:09.468506 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708046d3-fa95-4dbf-8e00-36f3a125ad08 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:09.468800 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708046d3-fa95-4dbf-8e00-36f3a125ad08 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:09.469072 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708046d3-fa95-4dbf-8e00-36f3a125ad08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:09.484538 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-8dc9f0b7-a820-4637-8d21-89db224f6fb4 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:17:09.485726 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-8dc9f0b7-a820-4637-8d21-89db224f6fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:09.489209 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-708046d3-fa95-4dbf-8e00-36f3a125ad08 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:17:09.490380 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-708046d3-fa95-4dbf-8e00-36f3a125ad08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:09.495019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 592/1159] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:17:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:17:09.498890 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 568/1160] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:17:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:17:09.502470 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9f0b7-a820-4637-8d21-89db224f6fb4 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:09.503427 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708046d3-fa95-4dbf-8e00-36f3a125ad08 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:09.508609 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9f0b7-a820-4637-8d21-89db224f6fb4 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:09.512122 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708046d3-fa95-4dbf-8e00-36f3a125ad08 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:09.513379 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d105a5-1183-4199-a81a-fdc48ee852f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:09.513987 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d105a5-1183-4199-a81a-fdc48ee852f1 admin admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:09.514257 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d105a5-1183-4199-a81a-fdc48ee852f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:09.514521 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d105a5-1183-4199-a81a-fdc48ee852f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:09.515128 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d105a5-1183-4199-a81a-fdc48ee852f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:17:09.515445 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d105a5-1183-4199-a81a-fdc48ee852f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:09.516749 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c57db-1ec3-435e-b6c8-97f93ab1bfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:09.517013 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d105a5-1183-4199-a81a-fdc48ee852f1 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:09.517482 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c57db-1ec3-435e-b6c8-97f93ab1bfc5 admin admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:09.517793 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c57db-1ec3-435e-b6c8-97f93ab1bfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:09.518069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c57db-1ec3-435e-b6c8-97f93ab1bfc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:09.518696 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c57db-1ec3-435e-b6c8-97f93ab1bfc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:17:09.519020 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c57db-1ec3-435e-b6c8-97f93ab1bfc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:09.521199 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: WARNING py.warnings [None req-f70c57db-1ec3-435e-b6c8-97f93ab1bfc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:17:09.521199 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: warnings.warn(msg) Sep 23 15:17:09.521199 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: Sep 23 15:17:09.522181 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c57db-1ec3-435e-b6c8-97f93ab1bfc5 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:09.528820 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 593/1161] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 15:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:17:09.536626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d105a5-1183-4199-a81a-fdc48ee852f1 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:09.539322 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 569/1162] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 15:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:17:09.546586 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d105a5-1183-4199-a81a-fdc48ee852f1 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:09.546845 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c57db-1ec3-435e-b6c8-97f93ab1bfc5 admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:09.551747 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf23e4-4d08-4dcc-ba24-e995158a570c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:09.552388 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf23e4-4d08-4dcc-ba24-e995158a570c admin admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:09.552672 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf23e4-4d08-4dcc-ba24-e995158a570c admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:09.552943 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf23e4-4d08-4dcc-ba24-e995158a570c admin admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:09.553561 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf23e4-4d08-4dcc-ba24-e995158a570c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:09.554645 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: WARNING py.warnings [None req-a9cf23e4-4d08-4dcc-ba24-e995158a570c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:17:09.554645 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: warnings.warn(msg) Sep 23 15:17:09.554645 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: Sep 23 15:17:09.555845 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf23e4-4d08-4dcc-ba24-e995158a570c admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:09.556219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c57db-1ec3-435e-b6c8-97f93ab1bfc5 admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:09.561090 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ea213-367f-4ea7-b07e-7b42914b40e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:09.561435 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ea213-367f-4ea7-b07e-7b42914b40e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:09.561724 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ea213-367f-4ea7-b07e-7b42914b40e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:09.561999 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ea213-367f-4ea7-b07e-7b42914b40e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:09.562612 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ea213-367f-4ea7-b07e-7b42914b40e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:09.564463 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ea213-367f-4ea7-b07e-7b42914b40e8 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:09.593142 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 594/1163] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 15:17:09 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:17:09.598214 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf23e4-4d08-4dcc-ba24-e995158a570c admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:09.608057 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 570/1164] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 15:17:09 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:17:09.609357 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ea213-367f-4ea7-b07e-7b42914b40e8 admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:09.659330 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf23e4-4d08-4dcc-ba24-e995158a570c admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:09.668995 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ea213-367f-4ea7-b07e-7b42914b40e8 admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:09.673512 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143d8be-666c-4b4f-9431-e8edd390d7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:09.674150 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143d8be-666c-4b4f-9431-e8edd390d7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:09.674474 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143d8be-666c-4b4f-9431-e8edd390d7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:09.674687 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143d8be-666c-4b4f-9431-e8edd390d7d2 admin admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:09.675300 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143d8be-666c-4b4f-9431-e8edd390d7d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:09.676292 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: WARNING py.warnings [None req-6143d8be-666c-4b4f-9431-e8edd390d7d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:17:09.676292 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: warnings.warn(msg) Sep 23 15:17:09.676292 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: Sep 23 15:17:09.677479 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143d8be-666c-4b4f-9431-e8edd390d7d2 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:09.701223 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 571/1165] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 15:17:09 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:17:09.705027 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143d8be-666c-4b4f-9431-e8edd390d7d2 admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:09.714356 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143d8be-666c-4b4f-9431-e8edd390d7d2 admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:09.716725 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c20bd7-9dc4-4e22-bb4a-ff1290bc76fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:09.717326 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c20bd7-9dc4-4e22-bb4a-ff1290bc76fe admin admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:09.717596 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c20bd7-9dc4-4e22-bb4a-ff1290bc76fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:09.717903 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c20bd7-9dc4-4e22-bb4a-ff1290bc76fe admin admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:09.718521 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c20bd7-9dc4-4e22-bb4a-ff1290bc76fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:09.722990 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee250bf4-fb79-4f87-a0e5-9106845a66c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:09.722990 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee250bf4-fb79-4f87-a0e5-9106845a66c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:09.722990 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee250bf4-fb79-4f87-a0e5-9106845a66c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:09.723816 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c20bd7-9dc4-4e22-bb4a-ff1290bc76fe admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:09.723915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee250bf4-fb79-4f87-a0e5-9106845a66c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:09.723915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee250bf4-fb79-4f87-a0e5-9106845a66c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:09.723915 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee250bf4-fb79-4f87-a0e5-9106845a66c3 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:09.736446 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 572/1166] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 15:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:17:09.740810 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee250bf4-fb79-4f87-a0e5-9106845a66c3 admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:09.744552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 595/1167] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 15:17:09 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:17:09.749297 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c20bd7-9dc4-4e22-bb4a-ff1290bc76fe admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:09.750952 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee250bf4-fb79-4f87-a0e5-9106845a66c3 admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:09.755577 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1c933-e57d-4000-a04a-caa4d288f847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:09.756164 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1c933-e57d-4000-a04a-caa4d288f847 admin admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:09.756434 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1c933-e57d-4000-a04a-caa4d288f847 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:09.756700 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1c933-e57d-4000-a04a-caa4d288f847 admin admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:09.757315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1c933-e57d-4000-a04a-caa4d288f847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:09.759027 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1c933-e57d-4000-a04a-caa4d288f847 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:09.759363 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c20bd7-9dc4-4e22-bb4a-ff1290bc76fe admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:09.764419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dd039-8893-49b8-a110-550d47c8cd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:09.764997 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dd039-8893-49b8-a110-550d47c8cd1a admin admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:09.765269 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dd039-8893-49b8-a110-550d47c8cd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:09.765531 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dd039-8893-49b8-a110-550d47c8cd1a admin admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:09.766200 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860dd039-8893-49b8-a110-550d47c8cd1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:09.767792 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860dd039-8893-49b8-a110-550d47c8cd1a admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:09.769811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 573/1168] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 15:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:17:09.773820 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1c933-e57d-4000-a04a-caa4d288f847 admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:09.778499 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 596/1169] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 15:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:17:09.782474 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dd039-8893-49b8-a110-550d47c8cd1a admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:09.784186 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1c933-e57d-4000-a04a-caa4d288f847 admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:09.789679 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37aa93d-153e-47e4-ba54-7a18b1d011c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:09.790423 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37aa93d-153e-47e4-ba54-7a18b1d011c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:09.790719 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37aa93d-153e-47e4-ba54-7a18b1d011c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:09.790969 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37aa93d-153e-47e4-ba54-7a18b1d011c3 admin admin] PATH_INFO: `/v3/projects/5d9ff8d21d7f4aff9e1d338259d39dd8/users/14b6fbae88244968ad611da4a5308eac/roles/dfd00108a3dd42f1a9dd0335f4b8f508` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:09.791905 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dd039-8893-49b8-a110-550d47c8cd1a admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:09.796363 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41123540-db6b-4a37-afef-3fef0afa5a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:09.796943 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41123540-db6b-4a37-afef-3fef0afa5a26 admin admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:09.797214 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41123540-db6b-4a37-afef-3fef0afa5a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:09.797479 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41123540-db6b-4a37-afef-3fef0afa5a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:09.798132 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41123540-db6b-4a37-afef-3fef0afa5a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:09.799695 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41123540-db6b-4a37-afef-3fef0afa5a26 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:09.806074 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37aa93d-153e-47e4-ba54-7a18b1d011c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9ff8d21d7f4aff9e1d338259d39dd8, user_id=14b6fbae88244968ad611da4a5308eac, role_id=dfd00108a3dd42f1a9dd0335f4b8f508)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:09.808729 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37aa93d-153e-47e4-ba54-7a18b1d011c3 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:09.809709 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 597/1170] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 15:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:17:09.813890 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41123540-db6b-4a37-afef-3fef0afa5a26 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:09.822570 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 574/1171] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 15:17:09 2022] PUT /identity/v3/projects/5d9ff8d21d7f4aff9e1d338259d39dd8/users/14b6fbae88244968ad611da4a5308eac/roles/dfd00108a3dd42f1a9dd0335f4b8f508 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:17:09.823290 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41123540-db6b-4a37-afef-3fef0afa5a26 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:09.827528 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4627a-d10f-4c25-b79b-7f25403c5278 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:09.827815 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4627a-d10f-4c25-b79b-7f25403c5278 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:09.828089 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4627a-d10f-4c25-b79b-7f25403c5278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:09.835396 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:17:09.848789 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-63a4627a-d10f-4c25-b79b-7f25403c5278 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:17:09.850057 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-63a4627a-d10f-4c25-b79b-7f25403c5278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:09.881965 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b9f35-f103-4d2f-85e1-b255e018d95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:09.882621 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b9f35-f103-4d2f-85e1-b255e018d95e admin admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:09.882894 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b9f35-f103-4d2f-85e1-b255e018d95e admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:09.883165 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b9f35-f103-4d2f-85e1-b255e018d95e admin admin] PATH_INFO: `/v3/projects/639c504f5c7b40979340c647cb64243b/users/356ff70d0c4343c4ab068559244687a9/roles/dfd00108a3dd42f1a9dd0335f4b8f508` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:09.894228 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:17:09.898039 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b9f35-f103-4d2f-85e1-b255e018d95e admin admin] RBAC: Authorizing `identity:create_grant(project_id=639c504f5c7b40979340c647cb64243b, user_id=356ff70d0c4343c4ab068559244687a9, role_id=dfd00108a3dd42f1a9dd0335f4b8f508)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:09.899122 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: WARNING py.warnings [None req-2c3b9f35-f103-4d2f-85e1-b255e018d95e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:17:09.899122 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: warnings.warn(msg) Sep 23 15:17:09.899122 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: Sep 23 15:17:09.901355 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b9f35-f103-4d2f-85e1-b255e018d95e admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:09.913991 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 575/1172] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:17:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:17:09.914388 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 598/1173] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 15:17:09 2022] PUT /identity/v3/projects/639c504f5c7b40979340c647cb64243b/users/356ff70d0c4343c4ab068559244687a9/roles/dfd00108a3dd42f1a9dd0335f4b8f508 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:17:09.921937 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407822db-fb8d-4301-9191-c6d0f5165b05 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:09.922258 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407822db-fb8d-4301-9191-c6d0f5165b05 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:09.922535 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407822db-fb8d-4301-9191-c6d0f5165b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:09.924851 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b9f35-f103-4d2f-85e1-b255e018d95e admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:09.942549 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-407822db-fb8d-4301-9191-c6d0f5165b05 None None] MFA Rules not processed for user `652ac5e448bf46d3bcf76749e06bdf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:17:09.943752 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-407822db-fb8d-4301-9191-c6d0f5165b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:09.981882 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b9f35-f103-4d2f-85e1-b255e018d95e admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:09.985935 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1857c5d-28a1-440f-a2a5-8a19847d2717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:09.986545 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1857c5d-28a1-440f-a2a5-8a19847d2717 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:09.986820 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1857c5d-28a1-440f-a2a5-8a19847d2717 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:09.987086 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1857c5d-28a1-440f-a2a5-8a19847d2717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:10.002965 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 576/1174] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:17:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:17:10.013501 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407822db-fb8d-4301-9191-c6d0f5165b05 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:10.022702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407822db-fb8d-4301-9191-c6d0f5165b05 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:10.026330 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a3dca-1224-4e4f-be3f-43aa83d0be60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:10.026932 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a3dca-1224-4e4f-be3f-43aa83d0be60 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:10.027208 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a3dca-1224-4e4f-be3f-43aa83d0be60 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:10.027475 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a3dca-1224-4e4f-be3f-43aa83d0be60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:10.036850 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a3dca-1224-4e4f-be3f-43aa83d0be60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:10.038338 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a3dca-1224-4e4f-be3f-43aa83d0be60 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:10.048249 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 577/1175] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:17:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:17:10.051917 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1857c5d-28a1-440f-a2a5-8a19847d2717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:10.053573 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1857c5d-28a1-440f-a2a5-8a19847d2717 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:10.063042 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 599/1176] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:17:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:17:15.195572 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dce1fc-5357-4b37-ba67-382feb4af73b None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:15.196075 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dce1fc-5357-4b37-ba67-382feb4af73b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:15.196217 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dce1fc-5357-4b37-ba67-382feb4af73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:15.246332 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-b0dce1fc-5357-4b37-ba67-382feb4af73b None None] MFA Rules not processed for user `14b6fbae88244968ad611da4a5308eac`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:17:15.247854 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-b0dce1fc-5357-4b37-ba67-382feb4af73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:15.349812 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 578/1177] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:17:15 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:17:15.352461 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1857c5d-28a1-440f-a2a5-8a19847d2717 service neutron] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:15.368952 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1857c5d-28a1-440f-a2a5-8a19847d2717 service neutron] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:15.380750 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38981850-0110-4e74-91e2-6e19abe59799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:15.381389 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38981850-0110-4e74-91e2-6e19abe59799 admin admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:15.381667 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38981850-0110-4e74-91e2-6e19abe59799 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:15.381965 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38981850-0110-4e74-91e2-6e19abe59799 admin admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:15.382633 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38981850-0110-4e74-91e2-6e19abe59799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:15.384581 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38981850-0110-4e74-91e2-6e19abe59799 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:15.455068 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 600/1178] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 15:17:15 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:17:15.455282 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dce1fc-5357-4b37-ba67-382feb4af73b None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:15.470444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dce1fc-5357-4b37-ba67-382feb4af73b None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:15.563083 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35515649-895c-4784-b880-8dfa7cc3886c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:15.563758 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35515649-895c-4784-b880-8dfa7cc3886c admin admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:15.564040 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35515649-895c-4784-b880-8dfa7cc3886c admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:15.564811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35515649-895c-4784-b880-8dfa7cc3886c admin admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:15.565088 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35515649-895c-4784-b880-8dfa7cc3886c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:15.567515 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35515649-895c-4784-b880-8dfa7cc3886c admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:15.582608 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:17:15.600679 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 579/1179] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 15:17:15 2022] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:17:15.605972 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38981850-0110-4e74-91e2-6e19abe59799 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:15.625858 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38981850-0110-4e74-91e2-6e19abe59799 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:15.630254 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117bbc5-9aa4-4be6-b95c-a3a9cf717119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:15.631033 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117bbc5-9aa4-4be6-b95c-a3a9cf717119 admin admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:15.631758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117bbc5-9aa4-4be6-b95c-a3a9cf717119 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:15.631758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117bbc5-9aa4-4be6-b95c-a3a9cf717119 admin admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:15.632363 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117bbc5-9aa4-4be6-b95c-a3a9cf717119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:15.634115 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117bbc5-9aa4-4be6-b95c-a3a9cf717119 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:15.649903 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 601/1180] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 15:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:17:15.651013 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35515649-895c-4784-b880-8dfa7cc3886c admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:15.677021 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35515649-895c-4784-b880-8dfa7cc3886c admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:15.682484 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae6602-2dc2-4538-92f2-8eba3d057d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:15.683192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae6602-2dc2-4538-92f2-8eba3d057d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:15.683471 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae6602-2dc2-4538-92f2-8eba3d057d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:15.683747 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae6602-2dc2-4538-92f2-8eba3d057d0e admin admin] PATH_INFO: `/v3/projects/267e3c037e9f472a93eb891bee357d07/users/a582f9e10165490b8198bb68bd21878c/roles/07d4069c848d4ee9abb586256ee26f20` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:15.704382 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae6602-2dc2-4538-92f2-8eba3d057d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=267e3c037e9f472a93eb891bee357d07, user_id=a582f9e10165490b8198bb68bd21878c, role_id=07d4069c848d4ee9abb586256ee26f20)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:15.707570 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae6602-2dc2-4538-92f2-8eba3d057d0e admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:15.735461 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 580/1181] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 15:17:15 2022] PUT /identity/v3/projects/267e3c037e9f472a93eb891bee357d07/users/a582f9e10165490b8198bb68bd21878c/roles/07d4069c848d4ee9abb586256ee26f20 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:17:15.739243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117bbc5-9aa4-4be6-b95c-a3a9cf717119 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:15.753342 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117bbc5-9aa4-4be6-b95c-a3a9cf717119 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:15.769294 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:17:15.839009 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e2d23-cb4c-4866-b14d-8d0bc47767cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:15.840552 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e2d23-cb4c-4866-b14d-8d0bc47767cc admin admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:15.841020 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e2d23-cb4c-4866-b14d-8d0bc47767cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:15.841491 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e2d23-cb4c-4866-b14d-8d0bc47767cc admin admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:15.842931 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e2d23-cb4c-4866-b14d-8d0bc47767cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:15.844760 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e2d23-cb4c-4866-b14d-8d0bc47767cc admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:15.858286 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 602/1182] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 15:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:17:15.862700 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae6602-2dc2-4538-92f2-8eba3d057d0e admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:15.878161 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae6602-2dc2-4538-92f2-8eba3d057d0e admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:15.887712 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259ee00-9266-4b57-961c-e568b11171fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:15.888645 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259ee00-9266-4b57-961c-e568b11171fd admin admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:15.888770 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259ee00-9266-4b57-961c-e568b11171fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:15.888999 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259ee00-9266-4b57-961c-e568b11171fd admin admin] PATH_INFO: `/v3/projects/267e3c037e9f472a93eb891bee357d07/users/a582f9e10165490b8198bb68bd21878c/roles/07d4069c848d4ee9abb586256ee26f20` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:15.891076 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259ee00-9266-4b57-961c-e568b11171fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=267e3c037e9f472a93eb891bee357d07, user_id=a582f9e10165490b8198bb68bd21878c, role_id=07d4069c848d4ee9abb586256ee26f20)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:15.894017 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259ee00-9266-4b57-961c-e568b11171fd admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:15.912379 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 581/1183] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 15:17:15 2022] PUT /identity/v3/projects/267e3c037e9f472a93eb891bee357d07/users/a582f9e10165490b8198bb68bd21878c/roles/07d4069c848d4ee9abb586256ee26f20 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:17:16.319386 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437747ed-139a-4c79-a8b0-1110d6668c28 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:16.319715 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437747ed-139a-4c79-a8b0-1110d6668c28 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:16.319996 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437747ed-139a-4c79-a8b0-1110d6668c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:16.356637 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-437747ed-139a-4c79-a8b0-1110d6668c28 None None] MFA Rules not processed for user `356ff70d0c4343c4ab068559244687a9`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:17:16.358121 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-437747ed-139a-4c79-a8b0-1110d6668c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:16.447918 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 603/1184] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:17:16 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:17:16.453275 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259ee00-9266-4b57-961c-e568b11171fd admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:16.545867 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259ee00-9266-4b57-961c-e568b11171fd admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:16.551875 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0617839-634a-4997-8bb1-46fcbb26740e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:16.552587 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0617839-634a-4997-8bb1-46fcbb26740e admin admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:16.552925 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0617839-634a-4997-8bb1-46fcbb26740e admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:16.553294 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0617839-634a-4997-8bb1-46fcbb26740e admin admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:16.554497 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0617839-634a-4997-8bb1-46fcbb26740e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:16.556482 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0617839-634a-4997-8bb1-46fcbb26740e admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:16.594260 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 582/1185] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 15:17:16 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:17:16.598278 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437747ed-139a-4c79-a8b0-1110d6668c28 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:16.652788 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437747ed-139a-4c79-a8b0-1110d6668c28 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:16.738235 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca716d-be97-4e83-92c6-9f5b4e7d572b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:16.739040 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca716d-be97-4e83-92c6-9f5b4e7d572b admin admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:16.739351 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca716d-be97-4e83-92c6-9f5b4e7d572b admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:16.739706 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca716d-be97-4e83-92c6-9f5b4e7d572b admin admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:16.740953 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca716d-be97-4e83-92c6-9f5b4e7d572b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:16.744198 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca716d-be97-4e83-92c6-9f5b4e7d572b admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:16.778299 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 604/1186] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 15:17:16 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:17:16.780992 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0617839-634a-4997-8bb1-46fcbb26740e admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:16.801906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0617839-634a-4997-8bb1-46fcbb26740e admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:16.839586 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac99350-2042-4e8b-8c1b-64cd39aa133a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:16.840557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac99350-2042-4e8b-8c1b-64cd39aa133a admin admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:16.840557 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac99350-2042-4e8b-8c1b-64cd39aa133a admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:16.840793 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac99350-2042-4e8b-8c1b-64cd39aa133a admin admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:16.841521 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac99350-2042-4e8b-8c1b-64cd39aa133a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:16.843191 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac99350-2042-4e8b-8c1b-64cd39aa133a admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:16.870667 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 583/1187] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 15:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:17:16.873369 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca716d-be97-4e83-92c6-9f5b4e7d572b admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:16.886665 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca716d-be97-4e83-92c6-9f5b4e7d572b admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:16.892334 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9da84-7f83-45cc-b58d-843219ab89fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:16.901521 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9da84-7f83-45cc-b58d-843219ab89fd admin admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:16.901889 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9da84-7f83-45cc-b58d-843219ab89fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:16.902162 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9da84-7f83-45cc-b58d-843219ab89fd admin admin] PATH_INFO: `/v3/projects/22de7c0faac04378a4e5fc3e483680e7/users/bb94b52dcdec4ad799d6332ed272d870/roles/07d4069c848d4ee9abb586256ee26f20` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:16.931080 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9da84-7f83-45cc-b58d-843219ab89fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=22de7c0faac04378a4e5fc3e483680e7, user_id=bb94b52dcdec4ad799d6332ed272d870, role_id=07d4069c848d4ee9abb586256ee26f20)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:16.952305 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9da84-7f83-45cc-b58d-843219ab89fd admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:16.973646 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 605/1188] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 15:17:16 2022] PUT /identity/v3/projects/22de7c0faac04378a4e5fc3e483680e7/users/bb94b52dcdec4ad799d6332ed272d870/roles/07d4069c848d4ee9abb586256ee26f20 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:17:16.975000 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac99350-2042-4e8b-8c1b-64cd39aa133a admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:16.988981 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac99350-2042-4e8b-8c1b-64cd39aa133a admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:17.075305 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a29cf-c06a-4ca9-9d2b-10e364676180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:17.076039 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a29cf-c06a-4ca9-9d2b-10e364676180 admin admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:17.076324 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a29cf-c06a-4ca9-9d2b-10e364676180 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:17.076925 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a29cf-c06a-4ca9-9d2b-10e364676180 admin admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:17.077570 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a29cf-c06a-4ca9-9d2b-10e364676180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:17.079416 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a29cf-c06a-4ca9-9d2b-10e364676180 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:17.093066 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 584/1189] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 15:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:17:17.097900 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9da84-7f83-45cc-b58d-843219ab89fd admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:17.115360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9da84-7f83-45cc-b58d-843219ab89fd admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:17.123471 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855d7af-ca02-46e3-9be1-daaf7a9efa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:17.124213 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855d7af-ca02-46e3-9be1-daaf7a9efa35 admin admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:17.124498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855d7af-ca02-46e3-9be1-daaf7a9efa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:17.124768 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855d7af-ca02-46e3-9be1-daaf7a9efa35 admin admin] PATH_INFO: `/v3/projects/22de7c0faac04378a4e5fc3e483680e7/users/bb94b52dcdec4ad799d6332ed272d870/roles/07d4069c848d4ee9abb586256ee26f20` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:17.127441 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855d7af-ca02-46e3-9be1-daaf7a9efa35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22de7c0faac04378a4e5fc3e483680e7, user_id=bb94b52dcdec4ad799d6332ed272d870, role_id=07d4069c848d4ee9abb586256ee26f20)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:17.130873 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855d7af-ca02-46e3-9be1-daaf7a9efa35 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:17.136836 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:17:17.154420 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 606/1190] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 15:17:17 2022] PUT /identity/v3/projects/22de7c0faac04378a4e5fc3e483680e7/users/bb94b52dcdec4ad799d6332ed272d870/roles/07d4069c848d4ee9abb586256ee26f20 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:17:22.146307 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a45e47-0453-412c-a570-a38345959689 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:22.146908 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a45e47-0453-412c-a570-a38345959689 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:22.146908 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a45e47-0453-412c-a570-a38345959689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:22.181312 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-a4a45e47-0453-412c-a570-a38345959689 None None] MFA Rules not processed for user `a582f9e10165490b8198bb68bd21878c`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:17:22.183281 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-a4a45e47-0453-412c-a570-a38345959689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:22.201475 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:17:22.314835 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 585/1191] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:17:22 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:17:22.325360 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855d7af-ca02-46e3-9be1-daaf7a9efa35 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:22.328182 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-1855d7af-ca02-46e3-9be1-daaf7a9efa35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:22.436057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855d7af-ca02-46e3-9be1-daaf7a9efa35 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:22.440602 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb046e-a44a-42ac-933e-6d1bf0d6fc2c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f4a48b97bf9405eb44f593c41fe1e4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:22.441318 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb046e-a44a-42ac-933e-6d1bf0d6fc2c service glance] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:22.441799 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb046e-a44a-42ac-933e-6d1bf0d6fc2c service glance] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:22.442136 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb046e-a44a-42ac-933e-6d1bf0d6fc2c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:22.528335 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb046e-a44a-42ac-933e-6d1bf0d6fc2c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:22.531498 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb046e-a44a-42ac-933e-6d1bf0d6fc2c service glance] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:22.543051 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 607/1192] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:17:22 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:17:23.484782 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f4d1b-34ef-4ad4-ac85-17be01f03687 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:23.485266 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f4d1b-34ef-4ad4-ac85-17be01f03687 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:23.485389 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f4d1b-34ef-4ad4-ac85-17be01f03687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:23.516346 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-480f4d1b-34ef-4ad4-ac85-17be01f03687 None None] MFA Rules not processed for user `bb94b52dcdec4ad799d6332ed272d870`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:17:23.517625 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-480f4d1b-34ef-4ad4-ac85-17be01f03687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:23.600433 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 586/1193] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:17:23 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:17:23.611938 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb046e-a44a-42ac-933e-6d1bf0d6fc2c service glance] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:23.624266 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb046e-a44a-42ac-933e-6d1bf0d6fc2c service glance] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:23.628419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3616792-f6ce-4c96-9677-c47962c52ce7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f4a48b97bf9405eb44f593c41fe1e4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:23.629465 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3616792-f6ce-4c96-9677-c47962c52ce7 service glance] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:23.629999 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3616792-f6ce-4c96-9677-c47962c52ce7 service glance] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:23.630477 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3616792-f6ce-4c96-9677-c47962c52ce7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:23.698912 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3616792-f6ce-4c96-9677-c47962c52ce7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:23.700446 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3616792-f6ce-4c96-9677-c47962c52ce7 service glance] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:23.711354 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 608/1194] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:17:23 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:17:31.764651 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdfbf2-6df2-488d-abae-66f449ee9743 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:31.765198 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdfbf2-6df2-488d-abae-66f449ee9743 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:31.765198 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdfbf2-6df2-488d-abae-66f449ee9743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:31.791736 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-e3cdfbf2-6df2-488d-abae-66f449ee9743 None None] MFA Rules not processed for user `356ff70d0c4343c4ab068559244687a9`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:17:31.793300 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-e3cdfbf2-6df2-488d-abae-66f449ee9743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:31.816309 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 587/1195] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:17:31 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:17:32.222513 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211c398-dbb3-49f1-9f05-6f4bfcc376f8 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:32.223238 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211c398-dbb3-49f1-9f05-6f4bfcc376f8 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:32.223567 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211c398-dbb3-49f1-9f05-6f4bfcc376f8 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:32.225821 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 609/1196] 10.222.0.48 () {54 vars in 961 bytes} [Fri Sep 23 15:17:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:17:32.233059 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b023c34-48e9-4141-b3d2-a2dee27c9ce3 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:32.233352 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b023c34-48e9-4141-b3d2-a2dee27c9ce3 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:32.233630 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b023c34-48e9-4141-b3d2-a2dee27c9ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:32.272962 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-7b023c34-48e9-4141-b3d2-a2dee27c9ce3 None None] MFA Rules not processed for user `542c7a84dd044588a42a9e3414cab516`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:17:32.274942 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-7b023c34-48e9-4141-b3d2-a2dee27c9ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:32.373100 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 588/1197] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Sep 23 15:17:32 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:17:32.381003 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35233225-37ae-46f4-882d-419a4dd64174 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:32.381463 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35233225-37ae-46f4-882d-419a4dd64174 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:32.381916 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35233225-37ae-46f4-882d-419a4dd64174 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:32.383419 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 610/1198] 10.222.0.48 () {54 vars in 912 bytes} [Fri Sep 23 15:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:17:32.389662 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef2e91-75b9-460d-9fe1-2397b019172b None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:32.389977 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef2e91-75b9-460d-9fe1-2397b019172b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:32.390249 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef2e91-75b9-460d-9fe1-2397b019172b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:32.420300 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-68ef2e91-75b9-460d-9fe1-2397b019172b None None] MFA Rules not processed for user `542c7a84dd044588a42a9e3414cab516`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:17:32.422100 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-68ef2e91-75b9-460d-9fe1-2397b019172b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:32.431624 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 589/1199] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Sep 23 15:17:32 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:17:32.444261 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35233225-37ae-46f4-882d-419a4dd64174 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:32.446380 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-35233225-37ae-46f4-882d-419a4dd64174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:32.461338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35233225-37ae-46f4-882d-419a4dd64174 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:32.465445 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2869c-c76d-4dd7-a4d8-eba6307d2e39 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f4a48b97bf9405eb44f593c41fe1e4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:32.466350 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2869c-c76d-4dd7-a4d8-eba6307d2e39 service glance] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:32.466626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2869c-c76d-4dd7-a4d8-eba6307d2e39 service glance] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:32.467150 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2869c-c76d-4dd7-a4d8-eba6307d2e39 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:32.480182 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2869c-c76d-4dd7-a4d8-eba6307d2e39 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:32.482390 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2869c-c76d-4dd7-a4d8-eba6307d2e39 service glance] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:32.497010 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 611/1200] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:17:32 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:17:32.874620 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8e800-9d9a-4b41-94dd-e707224e43a2 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:32.875141 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8e800-9d9a-4b41-94dd-e707224e43a2 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:32.875420 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8e800-9d9a-4b41-94dd-e707224e43a2 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:32.876519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 590/1201] 10.222.0.48 () {54 vars in 912 bytes} [Fri Sep 23 15:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:17:32.882431 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602cf9d-5534-48de-867a-4a5f416ce88f None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:32.882709 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602cf9d-5534-48de-867a-4a5f416ce88f None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:32.882977 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602cf9d-5534-48de-867a-4a5f416ce88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:32.928200 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-a602cf9d-5534-48de-867a-4a5f416ce88f None None] MFA Rules not processed for user `8098c9c25a384b33885bbe6bcaaf01a8`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:17:32.930310 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-a602cf9d-5534-48de-867a-4a5f416ce88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:32.940669 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:17:32.992853 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 612/1202] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Sep 23 15:17:32 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:17:33.005062 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8e800-9d9a-4b41-94dd-e707224e43a2 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:33.007481 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-d7d8e800-9d9a-4b41-94dd-e707224e43a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:33.024373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8e800-9d9a-4b41-94dd-e707224e43a2 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:33.028873 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b3c53-0a30-4d57-ad85-a7a293f8913b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:33.029476 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b3c53-0a30-4d57-ad85-a7a293f8913b service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:33.029798 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b3c53-0a30-4d57-ad85-a7a293f8913b service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:33.030070 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b3c53-0a30-4d57-ad85-a7a293f8913b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:33.035924 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:17:33.038485 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b3c53-0a30-4d57-ad85-a7a293f8913b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:33.042042 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b3c53-0a30-4d57-ad85-a7a293f8913b service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:33.055712 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 591/1203] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:17:33 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:17:33.595188 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6097e-7699-45ac-9e06-ecae48e83eae None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:33.596069 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6097e-7699-45ac-9e06-ecae48e83eae None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:33.596069 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6097e-7699-45ac-9e06-ecae48e83eae None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:33.597376 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 613/1204] 10.222.0.48 () {54 vars in 961 bytes} [Fri Sep 23 15:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:17:33.604374 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e873ce-7410-4e8f-97d1-8a152c67552f None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:33.604659 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e873ce-7410-4e8f-97d1-8a152c67552f None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:33.604948 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e873ce-7410-4e8f-97d1-8a152c67552f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:33.610971 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6097e-7699-45ac-9e06-ecae48e83eae None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:33.630251 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-a4e873ce-7410-4e8f-97d1-8a152c67552f None None] MFA Rules not processed for user `542c7a84dd044588a42a9e3414cab516`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:17:33.632160 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-a4e873ce-7410-4e8f-97d1-8a152c67552f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:33.642398 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 592/1205] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Sep 23 15:17:33 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:17:33.650794 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cedbc-175c-4681-810c-548419199a8e None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:33.651373 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cedbc-175c-4681-810c-548419199a8e None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:33.652140 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cedbc-175c-4681-810c-548419199a8e None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:33.660045 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 593/1206] 10.222.0.48 () {54 vars in 912 bytes} [Fri Sep 23 15:17:33 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:17:33.662329 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22627ba0-2ce9-472a-8102-48d2ef694e34 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:33.663062 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22627ba0-2ce9-472a-8102-48d2ef694e34 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:33.663437 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22627ba0-2ce9-472a-8102-48d2ef694e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:33.690402 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-22627ba0-2ce9-472a-8102-48d2ef694e34 None None] MFA Rules not processed for user `542c7a84dd044588a42a9e3414cab516`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:17:33.691776 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-22627ba0-2ce9-472a-8102-48d2ef694e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:33.695052 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6097e-7699-45ac-9e06-ecae48e83eae None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:33.701867 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 594/1207] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Sep 23 15:17:33 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:17:33.702016 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df73d7-15e5-492c-aa71-180b45cdd1bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4347073208466b885d960d92bdbc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:33.702640 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df73d7-15e5-492c-aa71-180b45cdd1bb service placement] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:33.702923 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df73d7-15e5-492c-aa71-180b45cdd1bb service placement] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:33.703488 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df73d7-15e5-492c-aa71-180b45cdd1bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:33.705230 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-84df73d7-15e5-492c-aa71-180b45cdd1bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:33.716190 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22627ba0-2ce9-472a-8102-48d2ef694e34 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:33.722654 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df73d7-15e5-492c-aa71-180b45cdd1bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:33.724534 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df73d7-15e5-492c-aa71-180b45cdd1bb service placement] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:33.726811 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22627ba0-2ce9-472a-8102-48d2ef694e34 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:33.730672 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca93bf-cb22-4cae-a6cc-a9aacb945945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:33.731442 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca93bf-cb22-4cae-a6cc-a9aacb945945 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:33.732031 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca93bf-cb22-4cae-a6cc-a9aacb945945 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:33.732308 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca93bf-cb22-4cae-a6cc-a9aacb945945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:33.741435 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 614/1208] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:17:33 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:17:33.746475 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca93bf-cb22-4cae-a6cc-a9aacb945945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:33.748583 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca93bf-cb22-4cae-a6cc-a9aacb945945 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:33.764167 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 595/1209] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:17:33 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:17:43.734338 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=49 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:17:43.757726 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=14 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:17:47.340927 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e94c9-7163-41fb-9f46-681ead4f9a90 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:47.341555 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e94c9-7163-41fb-9f46-681ead4f9a90 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:47.341555 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e94c9-7163-41fb-9f46-681ead4f9a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:47.361977 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-7c6e94c9-7163-41fb-9f46-681ead4f9a90 None None] MFA Rules not processed for user `8098c9c25a384b33885bbe6bcaaf01a8`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:17:47.363190 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-7c6e94c9-7163-41fb-9f46-681ead4f9a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:47.369539 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 615/1210] 10.222.0.89 () {58 vars in 1015 bytes} [Fri Sep 23 15:17:47 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:17:47.381933 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca93bf-cb22-4cae-a6cc-a9aacb945945 service neutron] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:47.391465 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca93bf-cb22-4cae-a6cc-a9aacb945945 service neutron] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:47.395846 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1972b-f756-4472-9c6e-34c77ed51af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:47.396446 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1972b-f756-4472-9c6e-34c77ed51af5 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:47.396723 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1972b-f756-4472-9c6e-34c77ed51af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:47.396997 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1972b-f756-4472-9c6e-34c77ed51af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:47.404516 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1972b-f756-4472-9c6e-34c77ed51af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:47.406284 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1972b-f756-4472-9c6e-34c77ed51af5 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:47.414517 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 596/1211] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:17:47 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:17:48.189470 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401b82b-0103-4465-a07e-d632320bf4f7 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:48.189898 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401b82b-0103-4465-a07e-d632320bf4f7 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:48.190045 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401b82b-0103-4465-a07e-d632320bf4f7 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:48.191393 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 616/1212] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 15:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:17:48.244112 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fc64a-5dbe-47e6-b27d-bf9f6ca5770d None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:48.244987 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fc64a-5dbe-47e6-b27d-bf9f6ca5770d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:48.245581 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fc64a-5dbe-47e6-b27d-bf9f6ca5770d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:48.271827 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-a06fc64a-5dbe-47e6-b27d-bf9f6ca5770d None None] MFA Rules not processed for user `542c7a84dd044588a42a9e3414cab516`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:17:48.275869 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-a06fc64a-5dbe-47e6-b27d-bf9f6ca5770d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:48.343757 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 597/1213] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 15:17:48 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:17:48.403674 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401b82b-0103-4465-a07e-d632320bf4f7 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:48.419489 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401b82b-0103-4465-a07e-d632320bf4f7 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:48.424541 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbeaf5-9bd5-4077-9d19-37b80813b721 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:48.425185 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbeaf5-9bd5-4077-9d19-37b80813b721 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:48.425530 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbeaf5-9bd5-4077-9d19-37b80813b721 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:48.425883 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbeaf5-9bd5-4077-9d19-37b80813b721 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:48.442123 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbeaf5-9bd5-4077-9d19-37b80813b721 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:48.445198 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbeaf5-9bd5-4077-9d19-37b80813b721 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:48.461907 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 617/1214] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:17:48 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:17:55.212744 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b1f27-705f-4357-af8f-97eba75ea0f4 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:55.213364 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b1f27-705f-4357-af8f-97eba75ea0f4 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:55.213364 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b1f27-705f-4357-af8f-97eba75ea0f4 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:55.215181 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 598/1215] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 15:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:17:55.224754 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536f142-e521-4f48-b17f-599eaea56423 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:55.225383 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536f142-e521-4f48-b17f-599eaea56423 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:55.225383 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536f142-e521-4f48-b17f-599eaea56423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:55.247803 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-5536f142-e521-4f48-b17f-599eaea56423 None None] MFA Rules not processed for user `542c7a84dd044588a42a9e3414cab516`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:17:55.249000 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-5536f142-e521-4f48-b17f-599eaea56423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:17:55.258348 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 618/1216] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 15:17:55 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:17:55.275899 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b1f27-705f-4357-af8f-97eba75ea0f4 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:17:55.290521 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b1f27-705f-4357-af8f-97eba75ea0f4 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:17:55.295982 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc57e6-ea94-4773-bcc1-4938c290c9b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:17:55.296657 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc57e6-ea94-4773-bcc1-4938c290c9b5 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:17:55.296960 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc57e6-ea94-4773-bcc1-4938c290c9b5 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:17:55.297227 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc57e6-ea94-4773-bcc1-4938c290c9b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:17:55.306187 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc57e6-ea94-4773-bcc1-4938c290c9b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:17:55.307772 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc57e6-ea94-4773-bcc1-4938c290c9b5 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:17:55.317282 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 599/1217] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:17:55 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:18:05.242508 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=12 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:05.313241 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=15 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:09.249496 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536f142-e521-4f48-b17f-599eaea56423 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:18:09.259758 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536f142-e521-4f48-b17f-599eaea56423 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:18:09.263789 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b257b0a-127d-4a17-bcee-48dcca77e81a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:18:09.264475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b257b0a-127d-4a17-bcee-48dcca77e81a service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:18:09.264832 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b257b0a-127d-4a17-bcee-48dcca77e81a service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:18:09.265195 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b257b0a-127d-4a17-bcee-48dcca77e81a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:18:09.275243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b257b0a-127d-4a17-bcee-48dcca77e81a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:18:09.276734 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b257b0a-127d-4a17-bcee-48dcca77e81a service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:18:09.286279 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 619/1218] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:18:09 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:18:11.298295 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364c9b6-5b01-4774-a90b-0746e1ef57c4 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:18:11.298865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364c9b6-5b01-4774-a90b-0746e1ef57c4 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:18:11.298865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364c9b6-5b01-4774-a90b-0746e1ef57c4 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:18:11.300247 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 600/1219] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 15:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:18:11.305480 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a051b88-7189-48e9-aa61-74d3284dfad6 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:18:11.306090 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a051b88-7189-48e9-aa61-74d3284dfad6 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:18:11.306090 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a051b88-7189-48e9-aa61-74d3284dfad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:18:11.335409 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-5a051b88-7189-48e9-aa61-74d3284dfad6 None None] MFA Rules not processed for user `542c7a84dd044588a42a9e3414cab516`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:18:11.336898 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-5a051b88-7189-48e9-aa61-74d3284dfad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:18:11.365948 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 620/1220] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 15:18:11 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:18:11.368702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364c9b6-5b01-4774-a90b-0746e1ef57c4 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:18:11.384677 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364c9b6-5b01-4774-a90b-0746e1ef57c4 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:18:11.390454 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6b2dd-f70f-47b5-9bd5-640977445cf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:18:11.391479 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6b2dd-f70f-47b5-9bd5-640977445cf1 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:18:11.392064 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6b2dd-f70f-47b5-9bd5-640977445cf1 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:18:11.392830 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6b2dd-f70f-47b5-9bd5-640977445cf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:18:11.403425 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6b2dd-f70f-47b5-9bd5-640977445cf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:18:11.405568 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6b2dd-f70f-47b5-9bd5-640977445cf1 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:18:11.437260 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 601/1221] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:18:11 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:18:21.321027 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=9 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:21.431067 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=6 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:22.543920 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78384f06-d52a-42ad-8cfd-d97ddbcea461 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:18:22.544476 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78384f06-d52a-42ad-8cfd-d97ddbcea461 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:18:22.544476 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78384f06-d52a-42ad-8cfd-d97ddbcea461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:18:22.564437 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-78384f06-d52a-42ad-8cfd-d97ddbcea461 None None] MFA Rules not processed for user `14b6fbae88244968ad611da4a5308eac`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:18:22.565651 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-78384f06-d52a-42ad-8cfd-d97ddbcea461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:18:22.572978 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 621/1222] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:18:22 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:18:22.887141 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5945e-e4fe-4950-91da-390001cd7be2 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:18:22.887673 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5945e-e4fe-4950-91da-390001cd7be2 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:18:22.887673 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5945e-e4fe-4950-91da-390001cd7be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:18:22.911096 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-bbf5945e-e4fe-4950-91da-390001cd7be2 None None] MFA Rules not processed for user `8098c9c25a384b33885bbe6bcaaf01a8`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:18:22.912299 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-bbf5945e-e4fe-4950-91da-390001cd7be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:18:22.919715 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 602/1223] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Sep 23 15:18:22 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:18:22.931550 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78384f06-d52a-42ad-8cfd-d97ddbcea461 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:18:22.942477 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78384f06-d52a-42ad-8cfd-d97ddbcea461 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:18:22.946695 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e4651-48d9-4789-afd3-7a0380438a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:18:22.947312 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e4651-48d9-4789-afd3-7a0380438a6e service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:18:22.947583 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e4651-48d9-4789-afd3-7a0380438a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:18:22.947846 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e4651-48d9-4789-afd3-7a0380438a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:18:22.955164 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e4651-48d9-4789-afd3-7a0380438a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:18:22.956590 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e4651-48d9-4789-afd3-7a0380438a6e service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:18:22.964470 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 622/1224] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:18:22 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:18:32.906029 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=3 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:32.961098 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=9 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:48.762402 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aed7d3-1fac-4cde-bc18-1b94cc644db9 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:18:48.762865 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aed7d3-1fac-4cde-bc18-1b94cc644db9 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:18:48.762945 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aed7d3-1fac-4cde-bc18-1b94cc644db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:18:48.783257 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-40aed7d3-1fac-4cde-bc18-1b94cc644db9 None None] MFA Rules not processed for user `14b6fbae88244968ad611da4a5308eac`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:18:48.784393 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-40aed7d3-1fac-4cde-bc18-1b94cc644db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:18:48.792043 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 603/1225] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:18:48 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:18:58.777234 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=3 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:03.659640 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c48c02-e62c-4426-a98c-12e88f419b22 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:19:03.660289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c48c02-e62c-4426-a98c-12e88f419b22 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:19:03.660289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c48c02-e62c-4426-a98c-12e88f419b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:19:03.680751 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-e6c48c02-e62c-4426-a98c-12e88f419b22 None None] MFA Rules not processed for user `14b6fbae88244968ad611da4a5308eac`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:19:03.682017 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-e6c48c02-e62c-4426-a98c-12e88f419b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:19:03.689586 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 623/1226] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:19:03 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:19:13.675537 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=3 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:05.168785 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6e544-69bf-419e-88d5-ccda0e566eb9 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:20:05.169553 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6e544-69bf-419e-88d5-ccda0e566eb9 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:20:05.169648 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6e544-69bf-419e-88d5-ccda0e566eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:20:05.195504 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-3ba6e544-69bf-419e-88d5-ccda0e566eb9 None None] MFA Rules not processed for user `14b6fbae88244968ad611da4a5308eac`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:20:05.196707 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-3ba6e544-69bf-419e-88d5-ccda0e566eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:20:05.203761 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 604/1227] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:20:05 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:20:15.190045 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=3 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:18.179056 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c48c02-e62c-4426-a98c-12e88f419b22 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:20:18.200838 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c48c02-e62c-4426-a98c-12e88f419b22 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:20:18.205100 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aba3ec-52f4-499e-8ee3-f85bd1c37175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:20:18.205764 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aba3ec-52f4-499e-8ee3-f85bd1c37175 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:20:18.206028 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aba3ec-52f4-499e-8ee3-f85bd1c37175 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:20:18.206300 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aba3ec-52f4-499e-8ee3-f85bd1c37175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:20:18.215626 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aba3ec-52f4-499e-8ee3-f85bd1c37175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:20:18.217050 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aba3ec-52f4-499e-8ee3-f85bd1c37175 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:20:18.226688 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 624/1228] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:20:18 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:20:28.222629 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=10 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:32.110677 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6e544-69bf-419e-88d5-ccda0e566eb9 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:21:32.141404 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6e544-69bf-419e-88d5-ccda0e566eb9 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:21:32.146898 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf137a-098c-4dd9-83b5-45b18b3803cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4347073208466b885d960d92bdbc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:21:32.147502 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf137a-098c-4dd9-83b5-45b18b3803cd service placement] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:21:32.147788 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf137a-098c-4dd9-83b5-45b18b3803cd service placement] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:21:32.148060 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf137a-098c-4dd9-83b5-45b18b3803cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:21:32.157006 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf137a-098c-4dd9-83b5-45b18b3803cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:21:32.158613 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf137a-098c-4dd9-83b5-45b18b3803cd service placement] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:21:32.168284 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 605/1229] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:21:32 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:21:42.164459 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=10 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:26.855753 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aba3ec-52f4-499e-8ee3-f85bd1c37175 service neutron] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:22:26.878642 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aba3ec-52f4-499e-8ee3-f85bd1c37175 service neutron] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:22:26.884475 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba774f-09d1-453c-8fd6-0723a0d7d17c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:22:26.885096 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba774f-09d1-453c-8fd6-0723a0d7d17c service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:22:26.885370 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba774f-09d1-453c-8fd6-0723a0d7d17c service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:22:26.885667 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba774f-09d1-453c-8fd6-0723a0d7d17c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:22:26.893824 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba774f-09d1-453c-8fd6-0723a0d7d17c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:22:26.895416 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba774f-09d1-453c-8fd6-0723a0d7d17c service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:22:26.904335 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 625/1230] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:22:26 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:22:31.821038 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b590886-f0e6-4fbe-a28b-e63dbb4deb41 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:22:31.822271 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b590886-f0e6-4fbe-a28b-e63dbb4deb41 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:22:31.822271 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b590886-f0e6-4fbe-a28b-e63dbb4deb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:22:31.841884 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-8b590886-f0e6-4fbe-a28b-e63dbb4deb41 None None] MFA Rules not processed for user `14b6fbae88244968ad611da4a5308eac`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:22:31.843122 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-8b590886-f0e6-4fbe-a28b-e63dbb4deb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:22:31.851310 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 606/1231] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:22:31 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:22:31.889289 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba774f-09d1-453c-8fd6-0723a0d7d17c service nova] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:22:31.953243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba774f-09d1-453c-8fd6-0723a0d7d17c service nova] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:22:31.957450 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8767b-4c51-4955-8d9b-37de51e572c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0274d60e5bf14a4a9d3477e0efe31988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:22:31.958098 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8767b-4c51-4955-8d9b-37de51e572c2 service cinder] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:22:31.958376 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8767b-4c51-4955-8d9b-37de51e572c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:22:31.958643 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8767b-4c51-4955-8d9b-37de51e572c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:22:31.968514 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8767b-4c51-4955-8d9b-37de51e572c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:22:31.970006 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8767b-4c51-4955-8d9b-37de51e572c2 service cinder] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:22:31.980753 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 626/1232] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:22:31 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:22:34.995383 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b590886-f0e6-4fbe-a28b-e63dbb4deb41 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:22:35.006549 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b590886-f0e6-4fbe-a28b-e63dbb4deb41 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:22:35.010287 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb89dc-fc02-4595-a8c0-c979afb66205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:22:35.010906 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb89dc-fc02-4595-a8c0-c979afb66205 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:22:35.011178 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb89dc-fc02-4595-a8c0-c979afb66205 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:22:35.011444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb89dc-fc02-4595-a8c0-c979afb66205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:22:35.021654 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb89dc-fc02-4595-a8c0-c979afb66205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:22:35.023124 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb89dc-fc02-4595-a8c0-c979afb66205 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:22:35.033795 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 607/1233] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:22:34 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:22:41.976120 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=40 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:45.028900 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=9 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:45.106218 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8767b-4c51-4955-8d9b-37de51e572c2 service cinder] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:22:45.116825 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8767b-4c51-4955-8d9b-37de51e572c2 service cinder] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:22:45.122964 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec1c08-2d75-4574-bd70-4141340bfe60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:22:45.123787 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec1c08-2d75-4574-bd70-4141340bfe60 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:22:45.123787 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec1c08-2d75-4574-bd70-4141340bfe60 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:22:45.124082 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec1c08-2d75-4574-bd70-4141340bfe60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:22:45.132650 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec1c08-2d75-4574-bd70-4141340bfe60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:22:45.134298 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec1c08-2d75-4574-bd70-4141340bfe60 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:22:45.144467 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 627/1234] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:22:45 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:22:46.847970 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb89dc-fc02-4595-a8c0-c979afb66205 service neutron] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:22:46.858219 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb89dc-fc02-4595-a8c0-c979afb66205 service neutron] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:22:46.862624 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c37432-cadb-45cf-8fec-5f02f5642efc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:22:46.863237 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c37432-cadb-45cf-8fec-5f02f5642efc service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:22:46.863517 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c37432-cadb-45cf-8fec-5f02f5642efc service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:22:46.863782 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c37432-cadb-45cf-8fec-5f02f5642efc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:22:46.871664 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c37432-cadb-45cf-8fec-5f02f5642efc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:22:46.873647 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c37432-cadb-45cf-8fec-5f02f5642efc service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:22:46.882101 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 608/1235] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:22:46 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:22:48.151479 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec1c08-2d75-4574-bd70-4141340bfe60 service nova] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:22:48.166243 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec1c08-2d75-4574-bd70-4141340bfe60 service nova] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:22:48.172035 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727c49f-8c3d-4579-b8dd-00100e2348ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:22:48.172671 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727c49f-8c3d-4579-b8dd-00100e2348ec service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:22:48.172953 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727c49f-8c3d-4579-b8dd-00100e2348ec service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:22:48.173225 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727c49f-8c3d-4579-b8dd-00100e2348ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:22:48.183874 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727c49f-8c3d-4579-b8dd-00100e2348ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:22:48.186105 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727c49f-8c3d-4579-b8dd-00100e2348ec service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:22:48.229253 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 628/1236] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:22:48 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:22:56.878289 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=6 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:58.201340 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=12 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:02.040823 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21689133-9b3c-4857-88b2-a0f195b2a6e8 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:02.041385 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21689133-9b3c-4857-88b2-a0f195b2a6e8 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:02.041385 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21689133-9b3c-4857-88b2-a0f195b2a6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:02.060601 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-21689133-9b3c-4857-88b2-a0f195b2a6e8 None None] MFA Rules not processed for user `356ff70d0c4343c4ab068559244687a9`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:23:02.061831 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-21689133-9b3c-4857-88b2-a0f195b2a6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:02.069061 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 609/1237] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:23:02 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:23:02.656150 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a006f-4f95-43e0-8fac-0fb66e9972fa None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:02.657098 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a006f-4f95-43e0-8fac-0fb66e9972fa None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:02.657422 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a006f-4f95-43e0-8fac-0fb66e9972fa None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:02.659748 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 629/1238] 10.222.0.48 () {54 vars in 961 bytes} [Fri Sep 23 15:23:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:23:02.665418 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402fc07-6cb9-4de2-bd56-428b96f00c0f None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:02.665721 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402fc07-6cb9-4de2-bd56-428b96f00c0f None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:02.666014 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402fc07-6cb9-4de2-bd56-428b96f00c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:02.745656 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-f402fc07-6cb9-4de2-bd56-428b96f00c0f None None] MFA Rules not processed for user `1d4347073208466b885d960d92bdbc77`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:23:02.746895 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-f402fc07-6cb9-4de2-bd56-428b96f00c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:02.755271 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 610/1239] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Sep 23 15:23:02 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:23:02.763379 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a006f-4f95-43e0-8fac-0fb66e9972fa None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:23:02.785428 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a006f-4f95-43e0-8fac-0fb66e9972fa None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:23:02.793054 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953519c-84b9-4a3b-b44d-6c1bd3d1d900 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4347073208466b885d960d92bdbc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:23:02.793641 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953519c-84b9-4a3b-b44d-6c1bd3d1d900 service placement] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:02.793947 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953519c-84b9-4a3b-b44d-6c1bd3d1d900 service placement] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:02.794216 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953519c-84b9-4a3b-b44d-6c1bd3d1d900 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:02.802526 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953519c-84b9-4a3b-b44d-6c1bd3d1d900 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:23:02.804095 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953519c-84b9-4a3b-b44d-6c1bd3d1d900 service placement] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:23:02.814145 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 630/1240] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:23:02 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:23:12.743407 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=21 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:12.809741 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=6 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:22.844761 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402fc07-6cb9-4de2-bd56-428b96f00c0f None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:23:22.857456 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402fc07-6cb9-4de2-bd56-428b96f00c0f None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:23:22.862526 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc56d8e-f95c-45bd-80e8-3c34f9ac0d42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:23:22.863147 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc56d8e-f95c-45bd-80e8-3c34f9ac0d42 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:22.863419 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc56d8e-f95c-45bd-80e8-3c34f9ac0d42 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:22.863676 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc56d8e-f95c-45bd-80e8-3c34f9ac0d42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:22.872540 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc56d8e-f95c-45bd-80e8-3c34f9ac0d42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:23:22.874363 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc56d8e-f95c-45bd-80e8-3c34f9ac0d42 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:23:22.885485 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 611/1241] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:23:22 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:23:31.096867 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953519c-84b9-4a3b-b44d-6c1bd3d1d900 service placement] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:23:31.109225 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953519c-84b9-4a3b-b44d-6c1bd3d1d900 service placement] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:23:31.114173 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af94123-506d-430a-bd30-13fd07646cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:23:31.114775 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af94123-506d-430a-bd30-13fd07646cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:31.115040 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af94123-506d-430a-bd30-13fd07646cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:31.115312 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af94123-506d-430a-bd30-13fd07646cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:31.125265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af94123-506d-430a-bd30-13fd07646cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:23:31.126751 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af94123-506d-430a-bd30-13fd07646cd5 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:23:31.136282 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 631/1242] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:23:31 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:23:32.880995 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=6 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:41.132150 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=6 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:40.761655 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbc015-e1da-400a-9540-5a2be43d8eb6 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:40.762228 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbc015-e1da-400a-9540-5a2be43d8eb6 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:40.762228 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbc015-e1da-400a-9540-5a2be43d8eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:40.785086 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-f2fbc015-e1da-400a-9540-5a2be43d8eb6 None None] MFA Rules not processed for user `14b6fbae88244968ad611da4a5308eac`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:40.786957 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-f2fbc015-e1da-400a-9540-5a2be43d8eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:40.798649 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 612/1243] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 15:24:40 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:24:41.136147 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af94123-506d-430a-bd30-13fd07646cd5 service neutron] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:24:41.149376 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af94123-506d-430a-bd30-13fd07646cd5 service neutron] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:24:41.155068 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f3414-efbd-4bbf-85c7-c401121bb342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:24:41.155677 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f3414-efbd-4bbf-85c7-c401121bb342 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:41.155981 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f3414-efbd-4bbf-85c7-c401121bb342 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:41.156250 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f3414-efbd-4bbf-85c7-c401121bb342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:41.164201 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f3414-efbd-4bbf-85c7-c401121bb342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:24:41.165640 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f3414-efbd-4bbf-85c7-c401121bb342 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:24:41.173529 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 632/1244] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:24:41 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:24:44.557485 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbc015-e1da-400a-9540-5a2be43d8eb6 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:24:44.570287 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbc015-e1da-400a-9540-5a2be43d8eb6 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:24:44.575367 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da5029-4706-4c8d-8cb0-788dc4754dfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542c7a84dd044588a42a9e3414cab516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:24:44.576123 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da5029-4706-4c8d-8cb0-788dc4754dfc service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:44.576405 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da5029-4706-4c8d-8cb0-788dc4754dfc service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:44.576678 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da5029-4706-4c8d-8cb0-788dc4754dfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:44.585245 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da5029-4706-4c8d-8cb0-788dc4754dfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:24:44.587220 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da5029-4706-4c8d-8cb0-788dc4754dfc service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:24:44.600290 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 613/1245] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:24:44 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:24:51.170315 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=6 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:54.593947 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=9 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:08.460482 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f3414-efbd-4bbf-85c7-c401121bb342 service neutron] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:26:08.480210 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f3414-efbd-4bbf-85c7-c401121bb342 service neutron] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:26:08.484651 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c8ba2-bac9-4729-9d06-1237ee47cf08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:26:08.485265 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c8ba2-bac9-4729-9d06-1237ee47cf08 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:08.485540 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c8ba2-bac9-4729-9d06-1237ee47cf08 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:08.485842 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c8ba2-bac9-4729-9d06-1237ee47cf08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:08.581743 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c8ba2-bac9-4729-9d06-1237ee47cf08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:26:08.583278 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c8ba2-bac9-4729-9d06-1237ee47cf08 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:26:08.602901 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 633/1246] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:26:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:26:11.936664 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5914654-14cb-43c7-b8a3-1412bb38a339 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:11.937213 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5914654-14cb-43c7-b8a3-1412bb38a339 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:11.937336 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5914654-14cb-43c7-b8a3-1412bb38a339 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:11.938806 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 614/1247] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 15:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:26:11.948057 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2398d3-d5d2-4c85-a446-176dd6605441 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:11.948485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2398d3-d5d2-4c85-a446-176dd6605441 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:11.948573 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2398d3-d5d2-4c85-a446-176dd6605441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:11.990020 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-cd2398d3-d5d2-4c85-a446-176dd6605441 None None] MFA Rules not processed for user `1d4347073208466b885d960d92bdbc77`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:26:11.991521 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-cd2398d3-d5d2-4c85-a446-176dd6605441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:12.011296 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 634/1248] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 15:26:11 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:26:12.029482 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5914654-14cb-43c7-b8a3-1412bb38a339 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:26:12.031366 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-d5914654-14cb-43c7-b8a3-1412bb38a339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:12.047680 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5914654-14cb-43c7-b8a3-1412bb38a339 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:26:12.052730 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a81b7f-5a06-49f2-9515-fdb012718ec9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4347073208466b885d960d92bdbc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:26:12.053291 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a81b7f-5a06-49f2-9515-fdb012718ec9 service placement] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:12.053566 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a81b7f-5a06-49f2-9515-fdb012718ec9 service placement] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:12.053888 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a81b7f-5a06-49f2-9515-fdb012718ec9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:12.062091 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a81b7f-5a06-49f2-9515-fdb012718ec9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:26:12.063790 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a81b7f-5a06-49f2-9515-fdb012718ec9 service placement] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:26:12.073519 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 615/1249] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:26:12 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:26:15.093892 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2398d3-d5d2-4c85-a446-176dd6605441 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:26:15.106138 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2398d3-d5d2-4c85-a446-176dd6605441 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:26:15.111529 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c31394-d6b0-4b5b-b866-b2085424bdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:26:15.112259 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c31394-d6b0-4b5b-b866-b2085424bdcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:15.112612 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c31394-d6b0-4b5b-b866-b2085424bdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:15.113047 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c31394-d6b0-4b5b-b866-b2085424bdcd admin admin] PATH_INFO: `/v3/users/356ff70d0c4343c4ab068559244687a9` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:15.114272 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c31394-d6b0-4b5b-b866-b2085424bdcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=356ff70d0c4343c4ab068559244687a9)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:26:15.115461 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: WARNING py.warnings [None req-87c31394-d6b0-4b5b-b866-b2085424bdcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:26:15.115461 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: warnings.warn(msg) Sep 23 15:26:15.115461 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: Sep 23 15:26:15.116827 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c31394-d6b0-4b5b-b866-b2085424bdcd admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:26:15.185019 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-87c31394-d6b0-4b5b-b866-b2085424bdcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '356ff70d0c4343c4ab068559244687a9'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:26:15.185659 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-87c31394-d6b0-4b5b-b866-b2085424bdcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '356ff70d0c4343c4ab068559244687a9'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:26:15.193546 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-87c31394-d6b0-4b5b-b866-b2085424bdcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '356ff70d0c4343c4ab068559244687a9'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:26:15.204116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-87c31394-d6b0-4b5b-b866-b2085424bdcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '356ff70d0c4343c4ab068559244687a9'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:26:15.212094 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:15.226236 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-87c31394-d6b0-4b5b-b866-b2085424bdcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '356ff70d0c4343c4ab068559244687a9'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:26:15.233005 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 635/1250] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 15:26:15 2022] DELETE /identity/v3/users/356ff70d0c4343c4ab068559244687a9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:26:15.418549 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a81b7f-5a06-49f2-9515-fdb012718ec9 service placement] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:26:15.432901 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a81b7f-5a06-49f2-9515-fdb012718ec9 service placement] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:26:15.489968 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1f7f0-cc6b-42c8-b9c3-1899d36e1fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:26:15.490603 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1f7f0-cc6b-42c8-b9c3-1899d36e1fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:15.490877 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1f7f0-cc6b-42c8-b9c3-1899d36e1fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:15.491144 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1f7f0-cc6b-42c8-b9c3-1899d36e1fdf admin admin] PATH_INFO: `/v3/projects/639c504f5c7b40979340c647cb64243b` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:15.492266 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1f7f0-cc6b-42c8-b9c3-1899d36e1fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=639c504f5c7b40979340c647cb64243b)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:26:15.493284 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: WARNING py.warnings [None req-5de1f7f0-cc6b-42c8-b9c3-1899d36e1fdf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:26:15.493284 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: warnings.warn(msg) Sep 23 15:26:15.493284 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: Sep 23 15:26:15.494488 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1f7f0-cc6b-42c8-b9c3-1899d36e1fdf admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:26:15.550438 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-5de1f7f0-cc6b-42c8-b9c3-1899d36e1fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '639c504f5c7b40979340c647cb64243b', 'request_id': 'req-5de1f7f0-cc6b-42c8-b9c3-1899d36e1fdf'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:26:15.559974 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-5de1f7f0-cc6b-42c8-b9c3-1899d36e1fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '639c504f5c7b40979340c647cb64243b', 'request_id': 'req-5de1f7f0-cc6b-42c8-b9c3-1899d36e1fdf'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:26:15.566161 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-5de1f7f0-cc6b-42c8-b9c3-1899d36e1fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '639c504f5c7b40979340c647cb64243b', 'request_id': 'req-5de1f7f0-cc6b-42c8-b9c3-1899d36e1fdf'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:26:15.598841 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-5de1f7f0-cc6b-42c8-b9c3-1899d36e1fdf admin admin] The token cache is being invalidate because project 639c504f5c7b40979340c647cb64243b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:26:15.599007 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-5de1f7f0-cc6b-42c8-b9c3-1899d36e1fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:26:15.599707 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-5de1f7f0-cc6b-42c8-b9c3-1899d36e1fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:26:15.601266 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 616/1251] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 15:26:15 2022] DELETE /identity/v3/projects/639c504f5c7b40979340c647cb64243b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:26:15.605531 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c31394-d6b0-4b5b-b866-b2085424bdcd admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:26:15.607187 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-87c31394-d6b0-4b5b-b866-b2085424bdcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:15.620434 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c31394-d6b0-4b5b-b866-b2085424bdcd admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:26:15.685713 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10b857-15af-4e01-a815-201859a37055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:26:15.686739 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10b857-15af-4e01-a815-201859a37055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:15.687011 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10b857-15af-4e01-a815-201859a37055 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:15.687275 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10b857-15af-4e01-a815-201859a37055 admin admin] PATH_INFO: `/v3/users/bb94b52dcdec4ad799d6332ed272d870` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:15.689170 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10b857-15af-4e01-a815-201859a37055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb94b52dcdec4ad799d6332ed272d870)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:26:15.691820 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10b857-15af-4e01-a815-201859a37055 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:26:15.745501 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-cf10b857-15af-4e01-a815-201859a37055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb94b52dcdec4ad799d6332ed272d870'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:26:15.746238 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-cf10b857-15af-4e01-a815-201859a37055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb94b52dcdec4ad799d6332ed272d870'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:26:15.756025 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-cf10b857-15af-4e01-a815-201859a37055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb94b52dcdec4ad799d6332ed272d870'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:26:15.764239 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-cf10b857-15af-4e01-a815-201859a37055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb94b52dcdec4ad799d6332ed272d870'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:26:15.776831 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-cf10b857-15af-4e01-a815-201859a37055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb94b52dcdec4ad799d6332ed272d870'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:26:15.782795 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 636/1252] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 15:26:15 2022] DELETE /identity/v3/users/bb94b52dcdec4ad799d6332ed272d870 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:26:15.964772 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1f7f0-cc6b-42c8-b9c3-1899d36e1fdf admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:26:15.966609 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-5de1f7f0-cc6b-42c8-b9c3-1899d36e1fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:15.981288 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1f7f0-cc6b-42c8-b9c3-1899d36e1fdf admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:26:16.039874 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5380eb-2017-4caf-8115-19c343bb7c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:26:16.040525 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5380eb-2017-4caf-8115-19c343bb7c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:16.040820 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5380eb-2017-4caf-8115-19c343bb7c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:16.041092 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5380eb-2017-4caf-8115-19c343bb7c12 admin admin] PATH_INFO: `/v3/projects/22de7c0faac04378a4e5fc3e483680e7` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:16.042307 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5380eb-2017-4caf-8115-19c343bb7c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22de7c0faac04378a4e5fc3e483680e7)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:26:16.044297 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5380eb-2017-4caf-8115-19c343bb7c12 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:26:16.052158 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:16.095029 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-2d5380eb-2017-4caf-8115-19c343bb7c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22de7c0faac04378a4e5fc3e483680e7', 'request_id': 'req-2d5380eb-2017-4caf-8115-19c343bb7c12'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:26:16.102911 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-2d5380eb-2017-4caf-8115-19c343bb7c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22de7c0faac04378a4e5fc3e483680e7', 'request_id': 'req-2d5380eb-2017-4caf-8115-19c343bb7c12'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:26:16.108233 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-2d5380eb-2017-4caf-8115-19c343bb7c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22de7c0faac04378a4e5fc3e483680e7', 'request_id': 'req-2d5380eb-2017-4caf-8115-19c343bb7c12'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:26:16.118918 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-2d5380eb-2017-4caf-8115-19c343bb7c12 admin admin] The token cache is being invalidate because project 22de7c0faac04378a4e5fc3e483680e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:26:16.119203 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-2d5380eb-2017-4caf-8115-19c343bb7c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:26:16.119863 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-2d5380eb-2017-4caf-8115-19c343bb7c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:26:16.121371 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 617/1253] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 15:26:15 2022] DELETE /identity/v3/projects/22de7c0faac04378a4e5fc3e483680e7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:26:25.779856 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:DELETE=12,keystone:SELECT=58,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:26.116192 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:37.017285 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10b857-15af-4e01-a815-201859a37055 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:26:37.018892 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-cf10b857-15af-4e01-a815-201859a37055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:37.091651 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10b857-15af-4e01-a815-201859a37055 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:26:37.151931 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b3888-9b35-4c2a-aeac-3139c65efae2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4347073208466b885d960d92bdbc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:26:37.152545 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b3888-9b35-4c2a-aeac-3139c65efae2 service placement] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:37.152823 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b3888-9b35-4c2a-aeac-3139c65efae2 service placement] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:37.153094 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b3888-9b35-4c2a-aeac-3139c65efae2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:37.154892 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-b79b3888-9b35-4c2a-aeac-3139c65efae2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:37.165822 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b3888-9b35-4c2a-aeac-3139c65efae2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:26:37.167432 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b3888-9b35-4c2a-aeac-3139c65efae2 service placement] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:26:37.177380 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 637/1254] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:26:37 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:26:47.173116 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=58 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:27.588831 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5380eb-2017-4caf-8115-19c343bb7c12 admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:27:27.590972 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-2d5380eb-2017-4caf-8115-19c343bb7c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:27:27.665967 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5380eb-2017-4caf-8115-19c343bb7c12 admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:27:27.671855 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca3d8c-64df-487f-9bb5-4263b88c677c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0274d60e5bf14a4a9d3477e0efe31988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:27:27.672473 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca3d8c-64df-487f-9bb5-4263b88c677c service cinder] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:27:27.672748 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca3d8c-64df-487f-9bb5-4263b88c677c service cinder] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:27:27.673016 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca3d8c-64df-487f-9bb5-4263b88c677c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:27:27.675174 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-d4ca3d8c-64df-487f-9bb5-4263b88c677c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:27:27.770275 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca3d8c-64df-487f-9bb5-4263b88c677c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:27:27.771726 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca3d8c-64df-487f-9bb5-4263b88c677c service cinder] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:27:27.791702 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 618/1255] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:27:27 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:27:29.098375 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b3888-9b35-4c2a-aeac-3139c65efae2 service placement] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:27:29.099920 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-b79b3888-9b35-4c2a-aeac-3139c65efae2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:27:29.156604 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b3888-9b35-4c2a-aeac-3139c65efae2 service placement] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:27:29.160526 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d28a8-8165-4678-93e6-df40481dbb18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8098c9c25a384b33885bbe6bcaaf01a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:27:29.161132 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d28a8-8165-4678-93e6-df40481dbb18 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:27:29.161403 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d28a8-8165-4678-93e6-df40481dbb18 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:27:29.161670 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d28a8-8165-4678-93e6-df40481dbb18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:27:29.163463 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-697d28a8-8165-4678-93e6-df40481dbb18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:27:29.229573 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d28a8-8165-4678-93e6-df40481dbb18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:27:29.231062 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d28a8-8165-4678-93e6-df40481dbb18 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:27:29.240806 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 638/1256] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:27:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:27:32.400587 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697436c6-384e-4986-9928-e4ca7c95307b None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:27:32.401090 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697436c6-384e-4986-9928-e4ca7c95307b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:27:32.401188 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697436c6-384e-4986-9928-e4ca7c95307b None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:27:32.402550 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 619/1257] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 15:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:27:32.413966 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73c95e-ebb8-40a3-9f2e-ac55b57ea719 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:27:32.414451 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73c95e-ebb8-40a3-9f2e-ac55b57ea719 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:27:32.414682 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73c95e-ebb8-40a3-9f2e-ac55b57ea719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:27:32.435175 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-bb73c95e-ebb8-40a3-9f2e-ac55b57ea719 None None] MFA Rules not processed for user `1d4347073208466b885d960d92bdbc77`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:27:32.436476 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-bb73c95e-ebb8-40a3-9f2e-ac55b57ea719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:27:32.445997 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 639/1258] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 15:27:32 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:27:32.460596 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697436c6-384e-4986-9928-e4ca7c95307b None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:27:32.463069 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-697436c6-384e-4986-9928-e4ca7c95307b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:27:32.484237 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697436c6-384e-4986-9928-e4ca7c95307b None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:27:32.489344 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25678cee-9cdd-4101-939a-1fb5c2b5c9fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4347073208466b885d960d92bdbc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:27:32.490039 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25678cee-9cdd-4101-939a-1fb5c2b5c9fe service placement] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:27:32.490315 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25678cee-9cdd-4101-939a-1fb5c2b5c9fe service placement] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:27:32.490586 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25678cee-9cdd-4101-939a-1fb5c2b5c9fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:27:32.499885 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25678cee-9cdd-4101-939a-1fb5c2b5c9fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:27:32.501510 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25678cee-9cdd-4101-939a-1fb5c2b5c9fe service placement] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:27:32.512421 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 620/1259] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:27:32 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:27:35.928210 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73c95e-ebb8-40a3-9f2e-ac55b57ea719 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:27:35.929874 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-bb73c95e-ebb8-40a3-9f2e-ac55b57ea719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:27:35.943855 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73c95e-ebb8-40a3-9f2e-ac55b57ea719 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:27:35.949151 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cfabd-cb07-42cc-9e6d-33ec195a3846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:27:35.949822 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cfabd-cb07-42cc-9e6d-33ec195a3846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:27:35.950097 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cfabd-cb07-42cc-9e6d-33ec195a3846 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:27:35.950362 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cfabd-cb07-42cc-9e6d-33ec195a3846 admin admin] PATH_INFO: `/v3/users/14b6fbae88244968ad611da4a5308eac` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:27:35.951515 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cfabd-cb07-42cc-9e6d-33ec195a3846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b6fbae88244968ad611da4a5308eac)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:27:35.953519 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cfabd-cb07-42cc-9e6d-33ec195a3846 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:27:36.002841 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-907cfabd-cb07-42cc-9e6d-33ec195a3846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b6fbae88244968ad611da4a5308eac'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:27:36.003503 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-907cfabd-cb07-42cc-9e6d-33ec195a3846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b6fbae88244968ad611da4a5308eac'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:27:36.012010 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-907cfabd-cb07-42cc-9e6d-33ec195a3846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b6fbae88244968ad611da4a5308eac'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:27:36.020047 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-907cfabd-cb07-42cc-9e6d-33ec195a3846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b6fbae88244968ad611da4a5308eac'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:27:36.034376 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-907cfabd-cb07-42cc-9e6d-33ec195a3846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b6fbae88244968ad611da4a5308eac'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:27:36.042954 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 640/1260] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 15:27:35 2022] DELETE /identity/v3/users/14b6fbae88244968ad611da4a5308eac => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:27:36.234957 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25678cee-9cdd-4101-939a-1fb5c2b5c9fe service placement] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:27:36.246666 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25678cee-9cdd-4101-939a-1fb5c2b5c9fe service placement] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:27:36.311933 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e8932-768a-4615-b447-c16ecb5a1718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:27:36.312568 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e8932-768a-4615-b447-c16ecb5a1718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:27:36.312840 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e8932-768a-4615-b447-c16ecb5a1718 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:27:36.313109 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e8932-768a-4615-b447-c16ecb5a1718 admin admin] PATH_INFO: `/v3/projects/5d9ff8d21d7f4aff9e1d338259d39dd8` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:27:36.314261 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e8932-768a-4615-b447-c16ecb5a1718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d9ff8d21d7f4aff9e1d338259d39dd8)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:27:36.316179 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e8932-768a-4615-b447-c16ecb5a1718 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:27:36.318537 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:36.376440 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-f63e8932-768a-4615-b447-c16ecb5a1718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d9ff8d21d7f4aff9e1d338259d39dd8', 'request_id': 'req-f63e8932-768a-4615-b447-c16ecb5a1718'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:27:36.385134 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-f63e8932-768a-4615-b447-c16ecb5a1718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d9ff8d21d7f4aff9e1d338259d39dd8', 'request_id': 'req-f63e8932-768a-4615-b447-c16ecb5a1718'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:27:36.392847 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-f63e8932-768a-4615-b447-c16ecb5a1718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d9ff8d21d7f4aff9e1d338259d39dd8', 'request_id': 'req-f63e8932-768a-4615-b447-c16ecb5a1718'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:27:36.404444 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-f63e8932-768a-4615-b447-c16ecb5a1718 admin admin] The token cache is being invalidate because project 5d9ff8d21d7f4aff9e1d338259d39dd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:27:36.404723 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-f63e8932-768a-4615-b447-c16ecb5a1718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:27:36.405421 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-f63e8932-768a-4615-b447-c16ecb5a1718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:27:36.406973 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 621/1261] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 15:27:36 2022] DELETE /identity/v3/projects/5d9ff8d21d7f4aff9e1d338259d39dd8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:27:36.411129 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cfabd-cb07-42cc-9e6d-33ec195a3846 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:27:36.412799 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-907cfabd-cb07-42cc-9e6d-33ec195a3846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:27:36.426794 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cfabd-cb07-42cc-9e6d-33ec195a3846 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:27:36.438917 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:36.488485 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05766e-3197-4168-b5c0-fd6e49c81ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:27:36.489185 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05766e-3197-4168-b5c0-fd6e49c81ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:27:36.489524 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05766e-3197-4168-b5c0-fd6e49c81ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:27:36.489961 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05766e-3197-4168-b5c0-fd6e49c81ea1 admin admin] PATH_INFO: `/v3/users/a582f9e10165490b8198bb68bd21878c` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:27:36.504136 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05766e-3197-4168-b5c0-fd6e49c81ea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a582f9e10165490b8198bb68bd21878c)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:27:36.506156 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05766e-3197-4168-b5c0-fd6e49c81ea1 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:27:36.554662 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-1f05766e-3197-4168-b5c0-fd6e49c81ea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a582f9e10165490b8198bb68bd21878c'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:27:36.555329 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-1f05766e-3197-4168-b5c0-fd6e49c81ea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a582f9e10165490b8198bb68bd21878c'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:27:36.562800 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-1f05766e-3197-4168-b5c0-fd6e49c81ea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a582f9e10165490b8198bb68bd21878c'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:27:36.570228 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-1f05766e-3197-4168-b5c0-fd6e49c81ea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a582f9e10165490b8198bb68bd21878c'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:27:36.581560 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-1f05766e-3197-4168-b5c0-fd6e49c81ea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a582f9e10165490b8198bb68bd21878c'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:27:36.587880 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 641/1262] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 15:27:36 2022] DELETE /identity/v3/users/a582f9e10165490b8198bb68bd21878c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:27:36.776700 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e8932-768a-4615-b447-c16ecb5a1718 admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:27:36.778902 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-f63e8932-768a-4615-b447-c16ecb5a1718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:27:36.797956 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e8932-768a-4615-b447-c16ecb5a1718 admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:27:36.856939 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da15a50-2b2d-4bb2-8347-31618db81e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652ac5e448bf46d3bcf76749e06bdf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6971859b35b44e69f745ee34120421d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:27:36.857619 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da15a50-2b2d-4bb2-8347-31618db81e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:27:36.857923 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da15a50-2b2d-4bb2-8347-31618db81e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:27:36.858169 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da15a50-2b2d-4bb2-8347-31618db81e1e admin admin] PATH_INFO: `/v3/projects/267e3c037e9f472a93eb891bee357d07` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:27:36.868856 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da15a50-2b2d-4bb2-8347-31618db81e1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=267e3c037e9f472a93eb891bee357d07)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:27:36.870978 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da15a50-2b2d-4bb2-8347-31618db81e1e admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:27:36.920316 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-1da15a50-2b2d-4bb2-8347-31618db81e1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '267e3c037e9f472a93eb891bee357d07', 'request_id': 'req-1da15a50-2b2d-4bb2-8347-31618db81e1e'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:27:36.928523 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-1da15a50-2b2d-4bb2-8347-31618db81e1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '267e3c037e9f472a93eb891bee357d07', 'request_id': 'req-1da15a50-2b2d-4bb2-8347-31618db81e1e'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:27:36.934337 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-1da15a50-2b2d-4bb2-8347-31618db81e1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '267e3c037e9f472a93eb891bee357d07', 'request_id': 'req-1da15a50-2b2d-4bb2-8347-31618db81e1e'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:27:36.945711 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-1da15a50-2b2d-4bb2-8347-31618db81e1e admin admin] The token cache is being invalidate because project 267e3c037e9f472a93eb891bee357d07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:27:36.946001 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-1da15a50-2b2d-4bb2-8347-31618db81e1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:27:36.946657 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-1da15a50-2b2d-4bb2-8347-31618db81e1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:27:36.948180 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 622/1263] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 15:27:36 2022] DELETE /identity/v3/projects/267e3c037e9f472a93eb891bee357d07 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:27:46.584531 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:46.942810 dv-osbrick-855012-3-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=78,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:43.021826 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05766e-3197-4168-b5c0-fd6e49c81ea1 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:43.023566 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-1f05766e-3197-4168-b5c0-fd6e49c81ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:43.105750 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05766e-3197-4168-b5c0-fd6e49c81ea1 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:43.167101 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a620e3-f56b-4fc4-9597-938dc27144e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4347073208466b885d960d92bdbc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85e9620ea42a69363d006d715ad04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:43.167711 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a620e3-f56b-4fc4-9597-938dc27144e3 service placement] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:43.167985 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a620e3-f56b-4fc4-9597-938dc27144e3 service placement] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:43.168245 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a620e3-f56b-4fc4-9597-938dc27144e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:43.170269 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-06a620e3-f56b-4fc4-9597-938dc27144e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:43.181555 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a620e3-f56b-4fc4-9597-938dc27144e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:43.183185 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a620e3-f56b-4fc4-9597-938dc27144e3 service placement] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:43.192859 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 642/1264] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 15:31:43 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:31:53.189034 dv-osbrick-855012-3-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=62 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}